-- Logs begin at Mon 2022-08-22 18:29:05 UTC, end at Mon 2022-08-22 20:16:00 UTC. -- Aug 22 19:09:54.311077 dv-cinder-835384-22-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 19:09:54.319756 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 19:09:54 2022] *** Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: nodename: dv-cinder-835384-22-iscsi Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: machine: x86_64 Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: clock source: unix Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: pcre jit disabled Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: detected number of CPU cores: 4 Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: current working directory: / Aug 22 19:09:54.322239 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: detected binary path: /usr/bin/uwsgi-core Aug 22 19:09:54.322902 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: your processes number limit is 47680 Aug 22 19:09:54.322902 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: your memory page size is 4096 bytes Aug 22 19:09:54.322902 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: detected max file descriptor number: 2048 Aug 22 19:09:54.322902 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: lock engine: pthread robust mutexes Aug 22 19:09:54.322902 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: thunder lock: enabled Aug 22 19:09:54.322902 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 19:09:54.322902 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 19:09:54.361170 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: Python main interpreter initialized at 0x55cd40ed59c0 Aug 22 19:09:54.361170 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: python threads support enabled Aug 22 19:09:54.361170 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: your server socket listen backlog is limited to 100 connections Aug 22 19:09:54.361170 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: your mercy for graceful operations on workers is 90 seconds Aug 22 19:09:54.361505 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 19:09:54.361580 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: *** Operational MODE: preforking *** Aug 22 19:09:54.361822 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: *** uWSGI is running in multiple interpreter mode *** Aug 22 19:09:54.361822 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: spawned uWSGI master process (pid: 105544) Aug 22 19:09:54.362001 dv-cinder-835384-22-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 19:09:54.366442 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: spawned uWSGI worker 1 (pid: 105545, cores: 1) Aug 22 19:09:54.366442 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: spawned uWSGI worker 2 (pid: 105546, cores: 1) Aug 22 19:09:54.366442 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 19:09:55.017826 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 19:09:55.018438 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 19:09:56.094756 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:09:56.094756 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: from cryptography.utils import int_from_bytes Aug 22 19:09:56.095393 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:09:56.095393 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: from cryptography.utils import int_from_bytes Aug 22 19:09:56.095827 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:09:56.095827 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: from cryptography.utils import int_from_bytes Aug 22 19:09:56.095966 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:09:56.095966 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: from cryptography.utils import int_from_bytes Aug 22 19:09:58.569010 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 19:09:58.569575 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 19:09:58.569790 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 19:09:58.570150 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 19:09:58.570403 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 19:09:58.570639 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 19:09:58.571013 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.571096 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 19:09:58.571180 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.571403 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.571506 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 19:09:58.571741 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.571853 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 19:09:58.572025 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 19:09:58.572110 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.572366 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.572450 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.572683 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.572776 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.572998 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.573083 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.573317 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.573415 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.573571 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.573663 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.573884 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.573983 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.574203 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-22-iscsi {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.574304 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.574522 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.574615 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.574825 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.574911 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.575087 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.575178 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.575402 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.575489 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.575751 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.575838 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-22-iscsi {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.576071 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.576165 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.576374 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.576465 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.576678 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.576868 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.576980 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.577999 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.578132 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.578255 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.578343 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.578492 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.578582 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.578582 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.578773 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.578862 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.578949 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.579028 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.579105 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.579181 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.579317 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.579401 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.579553 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.579724 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.579886 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.580033 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.580191 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.580424 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-22-iscsi {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.580511 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.580738 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.580830 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.581047 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.581195 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.581358 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.581498 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.581760 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-22-iscsi {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.581853 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.582066 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.582151 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.582372 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.582478 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.582691 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.582780 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.583009 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.583095 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.583314 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.583413 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.583637 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.583820 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.583985 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.584120 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.584834 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.584941 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.585149 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.585249 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.585447 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.585535 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.585753 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.585842 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.586056 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.586152 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.586372 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.586466 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.586667 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.586753 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.586967 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.587053 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.587220 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.587321 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.587523 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.587612 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.587867 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.587983 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.588170 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.588277 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.588416 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.588503 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.588720 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.588815 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.588965 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.589061 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.589281 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.589377 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.589598 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.589685 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.589876 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.589965 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.590136 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.590234 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.590438 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.590550 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.590754 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.590844 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.591059 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.591146 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.591359 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.591472 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.591678 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.591790 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.591985 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.592073 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.592286 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.592381 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.592590 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.592676 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.592894 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.592982 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.593199 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.593293 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.593510 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.593598 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.593823 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.593917 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.594135 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.594224 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.594438 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.594525 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.594756 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.594843 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.595070 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.595167 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.595378 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.595472 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.595701 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.595805 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.596022 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.596111 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.596328 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.596414 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.596631 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.596718 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.596936 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.597025 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.597249 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.597335 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.597555 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.597649 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.597857 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.597945 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.598104 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.598191 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.598406 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.598503 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.598709 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.598797 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.599025 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.599119 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.599297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.599392 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.599594 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.599705 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.599943 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.600043 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.600251 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.600391 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.600552 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.600641 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.600854 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.600948 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.601154 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.601242 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.601450 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.601537 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.601752 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.601853 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.602050 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.602138 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.602349 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.602435 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.602650 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.602736 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.602949 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.603036 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.603249 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.603344 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.603551 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.603665 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.603877 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.603968 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.604179 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.604266 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.604484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.604580 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.604787 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.604886 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.605086 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.605219 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.605393 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.605482 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.605695 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.605789 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.605995 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.606094 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.606302 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.606388 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.606602 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.606689 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.606904 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.606991 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.607212 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.607298 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.607511 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.607608 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.607837 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.607926 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.608136 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.608241 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.608695 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.608787 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.608995 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.609083 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.609299 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.609462 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.609595 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.609696 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.609896 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.609982 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.610198 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.610300 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.610499 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.610585 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.610798 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.610887 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.611095 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.611190 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.611394 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.611488 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.611712 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.611817 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.612019 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.612137 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.612316 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.612411 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.612618 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.612713 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.612914 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.613013 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.613214 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.613300 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.613528 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.613616 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.613833 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.613928 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.614138 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.614225 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.614440 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.614540 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.614755 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:09:58.614852 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.615086 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.615183 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.615443 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.615552 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.615784 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.615874 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.616097 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.616196 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.616410 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.616507 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.616734 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.616821 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.617047 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.617146 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.617357 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.617452 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.617664 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.617752 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.617981 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.618071 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.618289 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.618383 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.618599 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.618687 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.618909 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.619021 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.619219 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.619315 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.619532 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.619618 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.619865 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.619957 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.620180 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.620278 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.620492 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.620635 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.620808 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.620896 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.621112 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.621208 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.621422 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.621515 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.621747 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.621834 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.622069 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.622187 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.622379 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.622467 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.622691 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.622786 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.623011 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.623107 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.623308 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.623394 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.623615 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.623716 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.623960 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.624048 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.624268 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.624366 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.624579 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.624687 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.624883 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.624978 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.625188 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.625288 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.625501 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.625608 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.625809 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.625895 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.626118 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.626207 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.626423 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.626533 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.626734 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.626827 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.627046 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.627139 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.627353 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.627452 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.627679 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.627833 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.627997 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.628147 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.628308 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.628455 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.628600 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.628735 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.628910 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.629048 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.629214 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.629361 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.629509 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.629645 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.629807 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.629951 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.630095 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.630231 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.630397 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.630548 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.630722 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.630860 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.631505 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.631662 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.631843 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.632004 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.632162 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.632293 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.632511 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.632649 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.632794 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.632929 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.633064 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.633229 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.633366 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.633501 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.633648 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.633796 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.633933 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.634084 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.634228 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.634365 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.634535 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.634713 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.634839 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.634937 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.635146 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.635235 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.635446 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.635572 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.635773 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.635876 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.636083 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.636179 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.636385 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.636473 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.636685 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.636773 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.636992 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.637087 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.637291 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.637378 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.637594 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.637684 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.637904 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.637991 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.638211 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.638311 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.638520 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.638619 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.638825 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.638911 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.639133 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.639218 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.639453 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.639542 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.639786 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.639891 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.640100 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.640198 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.640421 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.640509 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.640735 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.640822 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.641035 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.641135 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.641344 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.641430 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.641648 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.641736 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.641951 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.642047 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.642250 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.642383 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.642557 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.642651 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.642857 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.642957 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.643159 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.643247 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.643459 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.643551 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.643783 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.643883 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.644084 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.644170 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.644387 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.644483 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.644691 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.644788 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.644990 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.645084 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.645289 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.645376 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.645588 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.645732 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.645906 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.645994 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.646207 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.646295 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.646508 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.646597 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.647364 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.647458 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.647728 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.647836 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.648037 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.648125 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.648357 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.648453 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.648672 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.648778 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.648982 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.649070 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.649292 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.649399 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.649600 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.649696 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.649906 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.649992 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.650211 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.650296 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.650520 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.650619 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.650826 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.650913 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.651131 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.651224 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.651445 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.651541 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.651775 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.651864 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.652093 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.652189 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.652395 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.652482 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.652712 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.652800 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.653017 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.653105 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.653332 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.653429 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.653636 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.653724 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.653950 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.654038 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.654264 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.654351 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.654577 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.654664 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.654887 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.654980 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.655198 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.655287 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.655503 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.655591 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.655838 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.655937 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.656144 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.656239 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.656451 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.656538 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.656754 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.656854 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.657064 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.657152 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.657379 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.657468 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.657688 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.657783 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.658002 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.658089 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.658305 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.658393 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.658617 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.658719 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.658921 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.659008 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.659235 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.659330 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.659535 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.659624 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.659869 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.659970 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.660187 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.660274 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.660497 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.660593 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.660804 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.660892 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.661107 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.661193 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.661460 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.661567 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.661695 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.661785 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.662003 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.662093 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.662330 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.662429 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.662632 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.662724 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.662933 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.663034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.663231 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.663318 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.663539 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.663626 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.663866 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.663972 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.664170 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.664260 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.664466 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.664551 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.664772 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.664904 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.665076 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.665172 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.665378 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.665466 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.665682 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.665788 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.665993 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.666094 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.666291 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.666379 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.666597 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.666693 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.666916 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.667009 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.667218 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.667317 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.667564 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.667673 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.667962 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.668067 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.668158 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.668279 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.668467 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.668589 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.668774 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.668893 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.669074 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.669195 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.669389 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.669479 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.669705 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.669859 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.670012 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.670102 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.670321 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.670410 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.670628 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.670723 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.670934 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.671031 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.671252 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.671340 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.671562 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.671701 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.671893 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.671992 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.672200 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.672288 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.672508 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.672636 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.672814 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.672911 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.673117 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.673205 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.673424 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.673520 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.673728 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.673824 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.674031 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.674117 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.674334 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.674420 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.674636 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.674725 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.674940 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.675024 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.675247 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.675334 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.675553 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.675833 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.675936 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.676164 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.676263 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.676474 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.676575 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.676788 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.677030 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.677126 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.677365 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.677460 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.677683 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.677777 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.678029 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.678121 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.678350 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.678447 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.678669 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.678774 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.678975 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.679070 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.679279 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.679367 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.679582 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.679698 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.679920 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.680020 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.680224 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.680311 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.680526 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.680622 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.680826 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.680913 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.681131 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.681217 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.681433 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.681528 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.681734 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.681821 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.682034 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.682121 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.682334 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.682428 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.682633 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.682759 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.682933 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.683021 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.683235 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.683333 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.683534 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.683629 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.683869 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.683956 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.684171 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.684271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.684470 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.684558 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.684769 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.684856 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.685070 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.685206 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.685382 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.685469 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.685684 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.685772 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.685989 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.686124 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.686288 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.686377 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.686626 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.686715 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.686930 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.687019 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.687228 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.687315 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.687551 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.687670 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.687882 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.687994 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.688186 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.688275 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.688488 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.688593 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.688795 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.688891 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.689100 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.689188 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.689399 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.689494 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.689699 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.689788 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.690001 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.690088 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.690304 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.690400 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.690603 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.690692 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.690900 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.690986 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.691201 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.691288 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.691498 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.691585 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.691824 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.691915 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.692124 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.692214 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.692421 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.692508 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.692719 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.692890 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.693023 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.693112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.693325 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.693412 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.694147 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.694243 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.694444 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.694532 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.694741 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.694828 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.695043 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.695129 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.695343 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.695439 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.695662 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.695753 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.695964 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.696063 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.696273 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.696370 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.696571 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.696659 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.696868 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.696964 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.697165 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.697252 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.697470 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.697558 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.697774 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.697875 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.698071 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.698158 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.698376 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.698464 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.698675 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.698774 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.698972 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.699060 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.699273 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.699369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.699577 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.699686 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.699912 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.700010 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.700210 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.700297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.700513 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.700601 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.700812 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.700907 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.701116 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.701203 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.701415 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.701509 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.701717 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.701804 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.702014 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.702107 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.702312 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.702399 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.702609 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.702694 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.702906 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.703000 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.703203 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.703290 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.703501 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.703601 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.703829 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.703931 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.704127 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.704214 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.704423 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.704509 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.704717 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.704813 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.705030 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.705117 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.705330 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.705464 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.705630 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.705765 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.705935 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.706023 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.706269 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.706355 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.706569 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.706657 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.706878 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.706966 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.707188 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.707284 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.707499 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.707588 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.707830 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.707932 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.708136 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.708231 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.708441 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.708536 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.708747 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.708833 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.709045 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.709149 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.709892 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.709993 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.710199 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.710293 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.710508 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.710604 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.710808 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.710895 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.711108 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.711195 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.711426 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.711527 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.711778 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.711871 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.712084 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.712170 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.712394 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.712494 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.712703 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.712791 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.713014 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.713101 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.713312 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.713412 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.713618 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.713706 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.713922 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.714017 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.714227 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.714394 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.714533 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.714627 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.714837 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.714924 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.715143 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.715230 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.715447 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.715587 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.715777 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.715879 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.716082 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.716171 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.716381 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.716467 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.716683 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.716769 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.716990 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.717080 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.717287 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.717381 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.717587 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.717682 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.717892 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.717979 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.718197 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.718284 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.718494 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.718588 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.718800 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.718910 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.719100 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.719219 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.719404 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.719528 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.719730 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.719857 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.720149 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.720237 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.720457 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.720562 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.720761 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.720855 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.721064 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.721165 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.721363 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.721459 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.721667 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.721776 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.721978 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.722086 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.722288 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.722378 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.722590 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.722685 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.722980 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.723067 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.723284 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.723389 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.723591 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.723695 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.723924 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.724011 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.724227 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.724321 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.724527 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.724621 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.724853 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.724950 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.725173 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.725260 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.725474 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.725569 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.725780 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.725884 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.726083 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.726171 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.726404 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.726531 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.726707 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.726808 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.727028 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.727168 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.727438 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.727526 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.727777 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.727884 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.728085 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.728175 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.728420 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.728514 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.728741 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.728830 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.729046 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.729141 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.729358 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.729446 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.729666 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.729779 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.729987 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.730085 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.730287 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.730375 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.730599 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.730689 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.730910 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.730998 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.731210 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.731299 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.731530 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.731629 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.731860 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.731950 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.732172 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.732258 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.732471 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.732567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.732793 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.732882 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.733112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.733210 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.733677 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.733791 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.733995 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.734092 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.734353 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.734440 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.734658 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.734755 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.734961 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.735051 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.735269 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.735358 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.735571 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.735688 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.735900 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.735993 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.736222 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.736312 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.736527 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.736674 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.736830 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.736918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.737133 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.737227 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.737440 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.737534 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.737744 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.737830 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.738047 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.738133 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.738353 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.738442 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.738655 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.738761 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.738957 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.739046 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.739262 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.739352 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.739576 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.739684 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.739905 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.739995 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.740209 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.740304 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.741042 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.741137 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.741349 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.741445 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.741651 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.741740 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.741951 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.742039 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.742253 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.742354 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.742561 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.742649 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.742865 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.742952 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.743167 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.743269 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.743472 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.743564 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.743834 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.743928 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.744138 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.744238 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.744474 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.744572 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.744779 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.744874 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.745099 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.745195 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.745409 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.745499 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.745729 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.745816 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.746035 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.746128 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.746338 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.746435 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.746647 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.746740 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.746950 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.747041 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.747253 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.747339 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.747554 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.747669 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.747884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.747975 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.748183 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.748270 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.748482 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.748582 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.748780 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.748866 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.749083 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.749171 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.749383 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.749480 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.749684 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.749772 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.749984 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.750071 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.750284 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.750379 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.750587 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.750682 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.750889 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.750977 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.751195 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.751291 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.751495 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.751583 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.751821 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.751922 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.752125 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.752215 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.752457 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.752544 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.752758 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.752844 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.753070 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.753166 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.753373 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.753512 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.753684 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.753778 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.753995 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.754091 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.754306 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.754393 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.754615 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.754716 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.754921 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.755008 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.755228 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.755315 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.755537 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.755633 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.755873 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.755964 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.756716 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.756935 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.757027 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.757265 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.757364 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.757581 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.757669 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.757900 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.758140 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.758237 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.758465 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.758554 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.758778 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.758876 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.759088 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.759189 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.759399 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.759494 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.759731 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.759835 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.760043 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.760132 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.760352 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.760439 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.760660 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.760751 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.760972 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.761062 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.761281 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.761370 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.761604 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.761691 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.761921 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.762012 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.762235 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.762323 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.762548 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.762646 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.762861 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.762948 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.763174 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.763262 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.763486 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.763629 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.763822 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.763911 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.764137 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.764236 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.764449 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.764539 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.764757 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.764846 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.765062 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.765151 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.765372 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.765462 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.765680 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.765774 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.765986 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.766092 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.766290 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.766381 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.766598 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.766685 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.766905 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.767002 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.767211 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.767299 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.767518 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.767607 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.767854 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.767956 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.768166 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.768263 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.768474 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.768569 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.768788 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.768887 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.769103 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.769308 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.769402 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.769626 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.769727 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.769961 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.770057 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.770288 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.770505 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.770614 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.770819 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.770915 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.771148 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.771238 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.771468 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.771563 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.772328 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.772499 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.772650 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.772783 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.772947 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.773094 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.773263 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.773394 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.773564 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.773715 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.773865 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.773969 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.774173 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.774263 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.774473 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.774568 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.774773 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.774875 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.775085 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.775173 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.775392 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.775614 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.775768 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.775980 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.776071 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.776296 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.776385 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.776619 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.776825 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.776942 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.777164 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.777259 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.777480 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.777568 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.777803 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.777893 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.778126 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.778221 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.778437 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.778525 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.778739 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.778834 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.779046 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.779133 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.779348 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.779434 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.779732 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.779826 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.779980 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.780067 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.780286 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.780386 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.780586 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.780673 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.780889 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.780977 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.781186 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.781285 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.781490 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.781586 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.781790 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.781878 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.782089 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.782189 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.782386 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.782480 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.782694 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.782782 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.782996 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.783094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.783296 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.783383 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.783594 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.783700 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.783923 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.784013 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.784221 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.784307 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.784520 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.784606 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.784816 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.784911 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.785114 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.785201 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.785420 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.785510 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.785719 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.785815 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.786022 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.786109 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.786319 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.786405 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.786626 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.786715 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.786924 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.787021 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.787230 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.787924 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.788099 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.788202 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.788422 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.788519 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.788725 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.788823 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.789038 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.789126 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.789348 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.789436 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.789674 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.789773 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.789993 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.790082 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.790302 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.790521 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.790619 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.790852 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.790942 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.791171 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.791260 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.791502 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.791783 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.791877 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.792123 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.792224 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.792439 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.792526 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.792746 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.792835 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.793068 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.793157 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.793378 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.793474 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.793684 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.793773 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.793989 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.794096 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.794294 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.794382 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.794602 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.794692 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.794908 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.794995 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.795216 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.795311 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.795523 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.795610 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.795853 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.795941 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.796159 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.796259 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.796466 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.796554 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.796772 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.796858 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.797077 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.797174 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.797384 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.797481 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.797692 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.797780 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.797999 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.798089 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.798306 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.798394 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.798613 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.798701 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.798926 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.799017 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.799236 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.799323 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.799545 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.799633 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.799879 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.799970 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.800188 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.800275 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.800498 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.800597 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.800806 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.800892 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.801115 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.801204 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.801422 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.801519 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.801724 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.801812 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.802035 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.802122 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.802363 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.802471 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.802673 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.802763 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.803000 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.803091 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.803367 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.803455 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.803751 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.803836 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.804073 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.804152 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.804380 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.804458 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.804769 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.804874 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.805016 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.805110 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.805311 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.805402 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.805620 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.805717 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.805944 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.806052 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.806254 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.806344 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.806559 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.806655 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.806865 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.806962 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.807168 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.807258 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.807476 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.807573 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.807828 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.807937 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.808133 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.808220 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.808432 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.808532 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.808735 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.808825 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.809045 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.809133 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.809347 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.809435 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.809648 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.809737 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.809947 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.810036 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.810250 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.810340 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.810548 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.810638 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.810846 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.810933 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.811143 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.811230 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.811441 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.811538 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.811766 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.811873 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.812067 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.812168 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.812367 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.812469 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.812668 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.812765 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.812967 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.813063 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.813265 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.813352 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.813563 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.813649 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.813867 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.813965 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.814163 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.814250 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.814465 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.814555 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.814766 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.814877 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.815066 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.815164 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.815363 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.815452 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.815714 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.815806 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.816035 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.816124 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.816343 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.816440 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.816661 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.816749 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.816970 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.817065 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.817280 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.817375 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.817585 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.817680 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.817903 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.817991 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.818213 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.818301 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.818541 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.818633 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.818852 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.818949 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.819208 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.819313 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.819469 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.819559 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.819803 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.819895 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.820111 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.820211 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.820422 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.820511 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.820730 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.820819 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.821039 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.821137 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.821352 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.821441 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.821670 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.821758 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.821970 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.822060 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.822282 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.822369 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.822595 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.822686 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.822909 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.822998 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.823219 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.823306 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.823524 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.823619 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.823861 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.823962 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.824167 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.824254 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.824474 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.824572 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.824797 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.824933 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.825085 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.825173 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.825391 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.825494 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.825701 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.825799 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.826011 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.826099 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.826317 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.826421 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.826631 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.826838 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.826939 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.827022 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.827252 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.827418 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.827575 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.827696 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.827909 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.827998 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.828232 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.828323 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.828555 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.828643 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.828869 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.828956 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.829181 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.829278 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.829487 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.829576 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.829729 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 19:09:58.829818 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.830126 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.830436 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.830740 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:09:58.830982 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 19:09:58.983178 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO dbcounter [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Registered counter for database nova_api Aug 22 19:09:58.983685 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO dbcounter [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Registered counter for database nova_api Aug 22 19:09:59.003209 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_db.sqlalchemy.engines [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:09:59.005009 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:09:59.009795 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writer thread running {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:09:59.011475 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writer thread running {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:09:59.065114 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.context [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b396f6b-723e-4dee-83de-557019f2714f(cell1) {{(pid=105546) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 19:09:59.066621 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.context [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b396f6b-723e-4dee-83de-557019f2714f(cell1) {{(pid=105545) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 19:09:59.069526 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_concurrency.lockutils [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:09:59.069940 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_concurrency.lockutils [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:09:59.070961 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:09:59.071433 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:09:59.071532 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_concurrency.lockutils [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:09:59.072210 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_concurrency.lockutils [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:09:59.072651 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_concurrency.lockutils [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:09:59.073012 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:09:59.073739 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:09:59.074189 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:09:59.074640 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_concurrency.lockutils [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:09:59.076193 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:09:59.076615 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO dbcounter [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Registered counter for database nova_cell0 Aug 22 19:09:59.078137 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO dbcounter [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Registered counter for database nova_cell0 Aug 22 19:09:59.082063 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO dbcounter [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Registered counter for database nova_cell1 Aug 22 19:09:59.083430 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO dbcounter [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Registered counter for database nova_cell1 Aug 22 19:09:59.090372 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_db.sqlalchemy.engines [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:09:59.092093 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_db.sqlalchemy.engines [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:09:59.094259 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:09:59.095126 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:09:59.098017 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writer thread running {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:09:59.100890 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writer thread running {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:09:59.101902 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writer thread running {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:09:59.104173 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writer thread running {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:09:59.248250 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO dbcounter [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Registered counter for database nova_cell0 Aug 22 19:09:59.252901 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO dbcounter [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Registered counter for database nova_cell0 Aug 22 19:09:59.257202 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG oslo_db.sqlalchemy.engines [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:09:59.261418 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writer thread running {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:09:59.261549 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:09:59.265793 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writer thread running {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:09:59.599521 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: WARNING keystonemiddleware.auth_token [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 19:09:59.601732 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: WARNING keystonemiddleware.auth_token [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 19:09:59.606800 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: WARNING keystonemiddleware.auth_token [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 19:09:59.609184 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: WARNING keystonemiddleware.auth_token [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 19:09:59.951428 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: WARNING keystonemiddleware.auth_token [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 19:09:59.951928 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: WARNING keystonemiddleware.auth_token [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 19:09:59.957388 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: WARNING keystonemiddleware.auth_token [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 19:09:59.957827 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: WARNING keystonemiddleware.auth_token [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 19:09:59.963214 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cd40ed59c0 pid: 105546 (default app) Aug 22 19:09:59.963692 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cd40ed59c0 pid: 105545 (default app) Aug 22 19:09:59.965279 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:09:59.966442 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-6a523509-f170-4c81-a1d4-ed10e0014ba5 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001695 Aug 22 19:09:59.966844 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Mon Aug 22 19:09:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:17.486565 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:17.487749 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Aug 22 19:11:17.488142 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:17.499364 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writing DB stats nova_api:SELECT=3 {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:11:17.500501 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writing DB stats nova_cell1:SELECT=3 {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:11:17.501444 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writing DB stats nova_cell0:SELECT=3 {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:11:17.502847 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:11:18.357243 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-2e88adaf-c6d1-415a-9c03-e59f4c746eaf admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:18.391203 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-2e88adaf-c6d1-415a-9c03-e59f4c746eaf admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.896987 Aug 22 19:11:18.392083 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 2/3] 10.222.0.61 () {60 vars in 1292 bytes} [Mon Aug 22 19:11:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:11:20.734929 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:20.736173 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-f3a58b87-5ee4-4a8b-9008-c55ab6ade5d3 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001385 Aug 22 19:11:20.743897 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 2/4] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:20 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:21.178635 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-6e991d62-24c4-4f5c-bd60-82dec8dfb5c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "swap": 0}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:21.199813 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:11:21.199813 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: warnings.warn(msg) Aug 22 19:11:21.229808 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-6e991d62-24c4-4f5c-bd60-82dec8dfb5c0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487644 Aug 22 19:11:21.230798 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 3/5] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:11:21.245233 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_api:SELECT=3 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:11:21.246346 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_cell0:SELECT=3 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:11:21.247121 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_cell1:SELECT=3 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:11:21.247993 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:11:21.453168 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-03469b0f-fba5-4899-b206-c364d5b1bd6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:21.457489 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:11:21.457489 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: warnings.warn(msg) Aug 22 19:11:21.520983 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-03469b0f-fba5-4899-b206-c364d5b1bd6e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281266 Aug 22 19:11:21.521750 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 3/6] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Aug 22 19:11:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:11:23.872430 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-6e991d62-24c4-4f5c-bd60-82dec8dfb5c0 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:23.874137 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-6e991d62-24c4-4f5c-bd60-82dec8dfb5c0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Aug 22 19:11:23.874842 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 4/7] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:24.524613 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-227368dd-6024-4c83-b1d0-c4c6076606b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "vcpus": 1, "name": "ds512M", "ram": 512}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:24.544509 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:11:24.544509 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: warnings.warn(msg) Aug 22 19:11:24.566340 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-227368dd-6024-4c83-b1d0-c4c6076606b6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.685304 Aug 22 19:11:24.567343 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 4/8] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:11:24.579139 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-a76464cf-e5e5-4054-8720-82410272ba18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:24.582490 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:11:24.582490 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: warnings.warn(msg) Aug 22 19:11:24.615170 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-a76464cf-e5e5-4054-8720-82410272ba18 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039567 Aug 22 19:11:24.628063 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 5/9] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Aug 22 19:11:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:11:26.963407 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-227368dd-6024-4c83-b1d0-c4c6076606b6 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:26.964392 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-227368dd-6024-4c83-b1d0-c4c6076606b6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 22 19:11:26.964785 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:27.313900 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-21026cf4-23e1-4cce-826d-8731708f8c3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "id": "d2", "vcpus": 1}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:27.333827 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-21026cf4-23e1-4cce-826d-8731708f8c3c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.363229 Aug 22 19:11:27.334440 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 6/11] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 19:11:27.346469 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-a6039c92-8bc9-4576-bdc9-559a8d44f676 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:27.370258 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-a6039c92-8bc9-4576-bdc9-559a8d44f676 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027473 Aug 22 19:11:27.370813 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 6/12] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Aug 22 19:11:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:11:29.708977 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-21026cf4-23e1-4cce-826d-8731708f8c3c admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:29.710023 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-21026cf4-23e1-4cce-826d-8731708f8c3c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 22 19:11:29.710430 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 7/13] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:30.192076 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-046b79fc-780a-419c-9fe5-cbf24fcb2231 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:30.215201 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-046b79fc-780a-419c-9fe5-cbf24fcb2231 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498674 Aug 22 19:11:30.215886 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 7/14] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 19:11:30.228542 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7f02de6b-39dc-459e-875a-6dd00696426e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:30.255702 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7f02de6b-39dc-459e-875a-6dd00696426e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030797 Aug 22 19:11:30.256403 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 8/15] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Aug 22 19:11:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:11:32.602526 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-046b79fc-780a-419c-9fe5-cbf24fcb2231 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:32.604205 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-046b79fc-780a-419c-9fe5-cbf24fcb2231 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Aug 22 19:11:32.607370 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 8/16] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:32 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:33.039626 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-1fd295a3-317a-47a3-8f3a-7d8c8cb9e69e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "swap": 0}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:33.060018 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-1fd295a3-317a-47a3-8f3a-7d8c8cb9e69e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448677 Aug 22 19:11:33.061059 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 9/17] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:11:33.073078 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-5d7d514c-c206-4a34-a214-04dffe63ab54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:33.106975 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-5d7d514c-c206-4a34-a214-04dffe63ab54 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037724 Aug 22 19:11:33.114819 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 9/18] 10.222.0.61 () {64 vars in 1336 bytes} [Mon Aug 22 19:11:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:11:35.480913 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-1fd295a3-317a-47a3-8f3a-7d8c8cb9e69e admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:35.481812 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-1fd295a3-317a-47a3-8f3a-7d8c8cb9e69e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001827 Aug 22 19:11:35.482276 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 10/19] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:35.909842 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-6a21fd76-6ddc-45e5-a36a-b15415269594 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:35.934995 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-6a21fd76-6ddc-45e5-a36a-b15415269594 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446860 Aug 22 19:11:35.935564 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 10/20] 10.222.0.61 () {60 vars in 1292 bytes} [Mon Aug 22 19:11:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:11:38.490021 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-1fd295a3-317a-47a3-8f3a-7d8c8cb9e69e admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:38.491070 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-1fd295a3-317a-47a3-8f3a-7d8c8cb9e69e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 22 19:11:38.491483 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 11/21] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:38.918154 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-3c1044a6-eb26-40e9-80f5-beb4f9ffc57a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "ram": 512}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:38.937577 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-3c1044a6-eb26-40e9-80f5-beb4f9ffc57a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.439365 Aug 22 19:11:38.939107 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 11/22] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:11:38.950449 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-e67075c4-c948-4d79-9b6e-8890d81540b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:38.974539 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-e67075c4-c948-4d79-9b6e-8890d81540b9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027698 Aug 22 19:11:38.975186 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 12/23] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Aug 22 19:11:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:11:41.277673 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-3c1044a6-eb26-40e9-80f5-beb4f9ffc57a admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:41.278681 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-3c1044a6-eb26-40e9-80f5-beb4f9ffc57a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 22 19:11:41.279081 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 12/24] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:41.674035 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-d67eb19e-51a2-4ff7-ac50-45070cf27fed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:41.693406 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-d67eb19e-51a2-4ff7-ac50-45070cf27fed admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408248 Aug 22 19:11:41.693904 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 13/25] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:11:41.705704 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-45056cd6-3612-40cb-a0b2-fa0bb3748817 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:41.728193 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-45056cd6-3612-40cb-a0b2-fa0bb3748817 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026143 Aug 22 19:11:41.728744 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 13/26] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Aug 22 19:11:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:11:44.076357 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-d67eb19e-51a2-4ff7-ac50-45070cf27fed admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:44.077790 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-d67eb19e-51a2-4ff7-ac50-45070cf27fed admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001959 Aug 22 19:11:44.078200 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 14/27] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:44.440959 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-6bb9e3b4-e7f4-4c09-a63b-58794e3af51d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:44.459872 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-6bb9e3b4-e7f4-4c09-a63b-58794e3af51d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.375242 Aug 22 19:11:44.460419 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 14/28] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:11:44.472781 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-0670c76d-43b9-411a-ada2-0c4fc7d3845c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:44.504989 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-0670c76d-43b9-411a-ada2-0c4fc7d3845c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036191 Aug 22 19:11:44.505581 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 15/29] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Aug 22 19:11:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:11:46.872273 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-6bb9e3b4-e7f4-4c09-a63b-58794e3af51d admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:46.873275 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-6bb9e3b4-e7f4-4c09-a63b-58794e3af51d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 22 19:11:46.873677 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 15/30] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:47.322780 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7ce120c8-7ba9-427c-a312-6d687fc455a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "id": "4", "rxtx_factor": 1.0, "disk": 80, "name": "m1.large"}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:47.344268 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7ce120c8-7ba9-427c-a312-6d687fc455a0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.464597 Aug 22 19:11:47.344817 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 16/31] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:11:47.356849 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-d0b79dfa-5434-4aeb-ac35-3019abc02b69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:47.385506 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-d0b79dfa-5434-4aeb-ac35-3019abc02b69 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032506 Aug 22 19:11:47.386088 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 16/32] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Aug 22 19:11:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:11:49.746442 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7ce120c8-7ba9-427c-a312-6d687fc455a0 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:11:49.748299 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7ce120c8-7ba9-427c-a312-6d687fc455a0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002301 Aug 22 19:11:49.748954 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 17/33] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:11:50.205080 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-47fd07e2-674b-4bbd-9e98-363c7f2c8cf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:50.224474 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-47fd07e2-674b-4bbd-9e98-363c7f2c8cf8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.468699 Aug 22 19:11:50.225629 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 17/34] 10.222.0.61 () {64 vars in 1283 bytes} [Mon Aug 22 19:11:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:11:50.237985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-807959cd-e74f-4b0d-9cda-803c2138b086 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:11:50.243272 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:11:50.270185 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-807959cd-e74f-4b0d-9cda-803c2138b086 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036152 Aug 22 19:11:50.281503 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 18/35] 10.222.0.61 () {64 vars in 1333 bytes} [Mon Aug 22 19:11:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:12:09.628275 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-47fd07e2-674b-4bbd-9e98-363c7f2c8cf8 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:09.629205 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-47fd07e2-674b-4bbd-9e98-363c7f2c8cf8 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 22 19:12:09.629605 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 18/36] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:12:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:12:10.015314 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-02ade9c2-3109-476c-b1a1-6081970c7bd7 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:10.034029 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-02ade9c2-3109-476c-b1a1-6081970c7bd7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398403 Aug 22 19:12:10.034559 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 19/37] 10.222.0.61 () {60 vars in 1292 bytes} [Mon Aug 22 19:12:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:12:11.078746 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-47fd07e2-674b-4bbd-9e98-363c7f2c8cf8 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:11.079771 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-47fd07e2-674b-4bbd-9e98-363c7f2c8cf8 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 22 19:12:11.080166 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 19/38] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:12:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:12:11.597942 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-bf9fe337-b642-4a4c-af72-d42deb4338ff admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:11.603809 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.wsgi [None req-bf9fe337-b642-4a4c-af72-d42deb4338ff admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-bf9fe337-b642-4a4c-af72-d42deb4338ff admin admin] Request method failure captured: Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Accept: application/json Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Accept-Encoding: gzip, deflate Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Connection: keep-alive Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Content-Length: 0 Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Host: 10.222.0.61 Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Openstack-Api-Version: compute 2.90 Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Openstack-System-Scope: None Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: User-Agent: python-novaclient Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Auth-Token: gAAAAABjA9UKc-O2FBZ7KT9fg6jbNn38yVmNHMutBpPIjPu_cftDErLbly2FZ10xvo0Mbh2JAwYK4TmFKLqYRoXrt-sCMYOvkaSHMz3ecSjKG9K3SFTgCxW8DS5_jsaTpDFyDQrv2B4GO9KOGyz31jdLda9qVcoEEWY-V0TbfYESelZirVmLa10 Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Domain-Id: None Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Domain-Name: None Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Identity-Status: Confirmed Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Is-Admin-Project: True Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Domain-Id: default Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Domain-Name: Default Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Name: admin Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Role: admin,member,reader Aug 22 19:12:11.607112 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Roles: admin,member,reader Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}] Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Tenant: admin Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Tenant-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Tenant-Name: admin Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User: admin Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Domain-Id: default Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Domain-Name: Default Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Id: d9c7158eb3ce41ab8bb7a5d05da4a2f6 Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Name: admin Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: method: > Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: exception: Flavor 42 could not be found. Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: action_args: {'id': '42'} Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:12:11.609222 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:11.610192 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.611711 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-bf9fe337-b642-4a4c-af72-d42deb4338ff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:12:11.612958 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-bf9fe337-b642-4a4c-af72-d42deb4338ff admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391323 Aug 22 19:12:11.612958 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 20/39] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Aug 22 19:12:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 19:12:11.618645 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-9be56218-4eb7-4af0-87c3-a76ac0da7040 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:11.622831 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:12:11.642300 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-9be56218-4eb7-4af0-87c3-a76ac0da7040 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027200 Aug 22 19:12:11.642831 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 20/40] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Aug 22 19:12:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:12:11.652473 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-c4a775d6-191a-4822-b8bb-b9707c915b5b admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:11.676224 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-c4a775d6-191a-4822-b8bb-b9707c915b5b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027326 Aug 22 19:12:11.676683 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 21/41] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Aug 22 19:12:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:12:11.686506 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-6313766b-4576-4316-b42b-4ae52d8a38fc admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:11.693371 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.wsgi [None req-6313766b-4576-4316-b42b-4ae52d8a38fc admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-6313766b-4576-4316-b42b-4ae52d8a38fc admin admin] Request method failure captured: Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Accept: application/json Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Accept-Encoding: gzip, deflate Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Connection: keep-alive Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Content-Length: 0 Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Host: 10.222.0.61 Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Openstack-Api-Version: compute 2.90 Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Openstack-System-Scope: None Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: User-Agent: python-novaclient Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Auth-Token: gAAAAABjA9UKc-O2FBZ7KT9fg6jbNn38yVmNHMutBpPIjPu_cftDErLbly2FZ10xvo0Mbh2JAwYK4TmFKLqYRoXrt-sCMYOvkaSHMz3ecSjKG9K3SFTgCxW8DS5_jsaTpDFyDQrv2B4GO9KOGyz31jdLda9qVcoEEWY-V0TbfYESelZirVmLa10 Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Domain-Id: None Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Domain-Name: None Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Identity-Status: Confirmed Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Is-Admin-Project: True Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Domain-Id: default Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Domain-Name: Default Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Name: admin Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Role: admin,member,reader Aug 22 19:12:11.696567 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Roles: admin,member,reader Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}] Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Tenant: admin Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Tenant-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Tenant-Name: admin Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User: admin Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Domain-Id: default Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Domain-Name: Default Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Id: d9c7158eb3ce41ab8bb7a5d05da4a2f6 Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Name: admin Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: method: > Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: exception: Flavor 42 could not be found. Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: action_args: {'id': '42'} Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:12:11.698144 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:11.699271 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:11.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-6313766b-4576-4316-b42b-4ae52d8a38fc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:12:11.701895 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-6313766b-4576-4316-b42b-4ae52d8a38fc admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015493 Aug 22 19:12:11.701895 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 21/42] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Aug 22 19:12:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 19:12:12.662915 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-c4a775d6-191a-4822-b8bb-b9707c915b5b admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:12.664030 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-c4a775d6-191a-4822-b8bb-b9707c915b5b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 22 19:12:12.664438 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 22/43] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:12:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:12:13.187746 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-974e95c5-ca90-4644-a083-a555d3ed1d63 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:13.192973 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.wsgi [None req-974e95c5-ca90-4644-a083-a555d3ed1d63 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-974e95c5-ca90-4644-a083-a555d3ed1d63 admin admin] Request method failure captured: Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Accept: application/json Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Accept-Encoding: gzip, deflate Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Connection: keep-alive Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Content-Length: 0 Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Host: 10.222.0.61 Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Openstack-Api-Version: compute 2.90 Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Openstack-System-Scope: None Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: User-Agent: python-novaclient Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Auth-Token: gAAAAABjA9UM4Kthk6RUAWxK5_xnM96r9fC-89Otoz3vhHtq0bRUA4uY0Cp9Rq_xEvk9sUVg7Bn2XuMtxHjHzNEyrRCi0t6TS9O5fR0qLCIZ6TDfULoTAkLIPbdJahygntbvt_fsYLj0shnyRjZ2-hfXVSrvC159FL9hiOQ6jTbDFdfMkeNpuM0 Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Domain-Id: None Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Domain-Name: None Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Identity-Status: Confirmed Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Is-Admin-Project: True Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Domain-Id: default Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Domain-Name: Default Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Name: admin Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Role: admin,member,reader Aug 22 19:12:13.194484 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Roles: admin,member,reader Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}] Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Tenant: admin Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Tenant-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Tenant-Name: admin Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User: admin Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Domain-Id: default Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Domain-Name: Default Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Id: d9c7158eb3ce41ab8bb7a5d05da4a2f6 Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Name: admin Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: method: > Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: exception: Flavor 84 could not be found. Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: action_args: {'id': '84'} Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:12:13.196034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:13.196918 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.198130 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-974e95c5-ca90-4644-a083-a555d3ed1d63 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:12:13.199347 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-974e95c5-ca90-4644-a083-a555d3ed1d63 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393581 Aug 22 19:12:13.199347 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 22/44] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Aug 22 19:12:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 19:12:13.206033 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7385bab9-054a-414b-8711-a08945f0b135 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:13.222001 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7385bab9-054a-414b-8711-a08945f0b135 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020096 Aug 22 19:12:13.222514 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 23/45] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Aug 22 19:12:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:12:13.231855 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-822b7927-a3aa-40cf-80cd-eadb2ec41278 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:13.246457 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-822b7927-a3aa-40cf-80cd-eadb2ec41278 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018271 Aug 22 19:12:13.246959 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 23/46] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Aug 22 19:12:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 19:12:13.256038 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-f1281eb5-0028-4488-9ba7-c7dc14afed6b admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:13.261372 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.wsgi [None req-f1281eb5-0028-4488-9ba7-c7dc14afed6b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-f1281eb5-0028-4488-9ba7-c7dc14afed6b admin admin] Request method failure captured: Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Accept: application/json Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Accept-Encoding: gzip, deflate Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Connection: keep-alive Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Content-Length: 0 Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Host: 10.222.0.61 Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Openstack-Api-Version: compute 2.90 Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Openstack-System-Scope: None Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: User-Agent: python-novaclient Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Auth-Token: gAAAAABjA9UM4Kthk6RUAWxK5_xnM96r9fC-89Otoz3vhHtq0bRUA4uY0Cp9Rq_xEvk9sUVg7Bn2XuMtxHjHzNEyrRCi0t6TS9O5fR0qLCIZ6TDfULoTAkLIPbdJahygntbvt_fsYLj0shnyRjZ2-hfXVSrvC159FL9hiOQ6jTbDFdfMkeNpuM0 Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Domain-Id: None Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Domain-Name: None Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Identity-Status: Confirmed Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Is-Admin-Project: True Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Domain-Id: default Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Domain-Name: Default Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Name: admin Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Role: admin,member,reader Aug 22 19:12:13.262884 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Roles: admin,member,reader Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}] Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Tenant: admin Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Tenant-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Tenant-Name: admin Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User: admin Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Domain-Id: default Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Domain-Name: Default Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Id: d9c7158eb3ce41ab8bb7a5d05da4a2f6 Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Name: admin Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: method: > Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: exception: Flavor 84 could not be found. Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: action_args: {'id': '84'} Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:12:13.264297 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:13.265642 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:13.266996 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-f1281eb5-0028-4488-9ba7-c7dc14afed6b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:12:13.268479 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-f1281eb5-0028-4488-9ba7-c7dc14afed6b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011755 Aug 22 19:12:13.268479 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 24/47] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Aug 22 19:12:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 19:12:14.219546 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-822b7927-a3aa-40cf-80cd-eadb2ec41278 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:14.220570 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-822b7927-a3aa-40cf-80cd-eadb2ec41278 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 22 19:12:14.220958 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 24/48] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:12:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:12:14.740816 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-0a41fb7b-f970-4a23-b292-1972ce261f87 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:14.746555 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.wsgi [None req-0a41fb7b-f970-4a23-b292-1972ce261f87 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-0a41fb7b-f970-4a23-b292-1972ce261f87 admin admin] Request method failure captured: Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Accept: application/json Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Accept-Encoding: gzip, deflate Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Connection: keep-alive Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Content-Length: 0 Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Host: 10.222.0.61 Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Openstack-Api-Version: compute 2.90 Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Openstack-System-Scope: None Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: User-Agent: python-novaclient Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Auth-Token: gAAAAABjA9UOEjOifqiZB0oQhh9XCF8d8ws_gUu7hIR417BNIX7T3fveIlatZJ9cWghgIWbmcaO-eblggaWVOunyur7ZhgYih4plib1uwU7_U-O3i2i--aEHZW9D8rO40yyi198JNmEFX-DlNdWJqX2Fgjm1SuG8vs6Qco-wa1GYiVrz2L3hi5Y Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Domain-Id: None Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Domain-Name: None Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Identity-Status: Confirmed Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Is-Admin-Project: True Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Domain-Id: default Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Domain-Name: Default Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Project-Name: admin Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Role: admin,member,reader Aug 22 19:12:14.748094 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Roles: admin,member,reader Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}] Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Tenant: admin Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Tenant-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-Tenant-Name: admin Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User: admin Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Domain-Id: default Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Domain-Name: Default Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Id: d9c7158eb3ce41ab8bb7a5d05da4a2f6 Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: X-User-Name: admin Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: method: > Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: exception: Flavor 451 could not be found. Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: action_args: {'id': '451'} Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:12:14.749748 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:14.750985 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.752344 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-0a41fb7b-f970-4a23-b292-1972ce261f87 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:12:14.753601 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-0a41fb7b-f970-4a23-b292-1972ce261f87 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391079 Aug 22 19:12:14.753601 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 25/49] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Aug 22 19:12:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 19:12:14.758858 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-6cc3b6c8-2c5f-4f77-9213-402c27644677 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:14.773821 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-6cc3b6c8-2c5f-4f77-9213-402c27644677 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018458 Aug 22 19:12:14.774337 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 25/50] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Aug 22 19:12:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:12:14.784046 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:14.798608 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018726 Aug 22 19:12:14.799153 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 26/51] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Aug 22 19:12:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 19:12:14.807858 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-c702fce8-df56-4c0e-bcfb-c9d50aead287 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:14.813456 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.wsgi [None req-c702fce8-df56-4c0e-bcfb-c9d50aead287 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-c702fce8-df56-4c0e-bcfb-c9d50aead287 admin admin] Request method failure captured: Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Accept: application/json Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Accept-Encoding: gzip, deflate Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Connection: keep-alive Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Content-Length: 0 Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Host: 10.222.0.61 Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Openstack-Api-Version: compute 2.90 Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Openstack-System-Scope: None Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: User-Agent: python-novaclient Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Auth-Token: gAAAAABjA9UOEjOifqiZB0oQhh9XCF8d8ws_gUu7hIR417BNIX7T3fveIlatZJ9cWghgIWbmcaO-eblggaWVOunyur7ZhgYih4plib1uwU7_U-O3i2i--aEHZW9D8rO40yyi198JNmEFX-DlNdWJqX2Fgjm1SuG8vs6Qco-wa1GYiVrz2L3hi5Y Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Domain-Id: None Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Domain-Name: None Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Identity-Status: Confirmed Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Is-Admin-Project: True Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Domain-Id: default Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Domain-Name: Default Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Project-Name: admin Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Role: admin,member,reader Aug 22 19:12:14.814925 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Roles: admin,member,reader Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4bc536d83f9841a59997d0d04e993cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4bc536d83f9841a59997d0d04e993cd8"}]}] Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Tenant: admin Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Tenant-Id: 4bc536d83f9841a59997d0d04e993cd8 Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-Tenant-Name: admin Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User: admin Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Domain-Id: default Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Domain-Name: Default Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Id: d9c7158eb3ce41ab8bb7a5d05da4a2f6 Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: X-User-Name: admin Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: method: > Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: exception: Flavor 451 could not be found. Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: action_args: {'id': '451'} Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:12:14.816450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:14.817332 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: ERROR nova.api.openstack.wsgi Aug 22 19:12:14.818369 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-c702fce8-df56-4c0e-bcfb-c9d50aead287 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:12:14.819390 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-c702fce8-df56-4c0e-bcfb-c9d50aead287 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011837 Aug 22 19:12:14.819390 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 26/52] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Aug 22 19:12:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 19:12:15.779976 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:15.781480 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001963 Aug 22 19:12:15.781879 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 27/53] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:12:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:12:16.304289 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-41fcb64d-4bb3-4a44-afa0-36919de8c15e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:12:16.325975 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-41fcb64d-4bb3-4a44-afa0-36919de8c15e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406132 Aug 22 19:12:16.326511 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 27/54] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Aug 22 19:12:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:12:17.277678 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:17.278745 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 22 19:12:17.279140 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 28/55] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:12:17.797570 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-7c393027-f1d3-4d6f-82d1-904603c2a5cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:12:17.816150 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-7c393027-f1d3-4d6f-82d1-904603c2a5cd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.399525 Aug 22 19:12:17.816685 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 28/56] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Aug 22 19:12:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:12:18.780452 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:18.781456 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Aug 22 19:12:18.781890 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 29/57] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:12:19.304494 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-47f4c280-c170-4c4b-ab34-f24c8208527a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:12:19.323434 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-47f4c280-c170-4c4b-ab34-f24c8208527a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402644 Aug 22 19:12:19.324002 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 29/58] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Aug 22 19:12:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:12:20.288551 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:20.289494 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 22 19:12:20.289888 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 30/59] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:12:20.809900 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-3eb4a34a-426e-4920-acfe-466514a3a6fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:12:20.829032 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-3eb4a34a-426e-4920-acfe-466514a3a6fe admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.402537 Aug 22 19:12:20.829621 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 30/60] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Aug 22 19:12:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:12:21.787590 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:21.788620 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 22 19:12:21.789021 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 31/61] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:12:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:12:22.309270 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-b942a757-2296-447c-a23e-47ba19fdd1ab admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:12:22.330244 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-b942a757-2296-447c-a23e-47ba19fdd1ab admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404155 Aug 22 19:12:22.330773 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 31/62] 10.222.0.61 () {60 vars in 1202 bytes} [Mon Aug 22 19:12:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:13:15.198385 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:13:15.199956 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-7a9c7836-57d2-440d-a22f-fd3437fa225d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Aug 22 19:13:15.200365 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 32/63] 10.222.0.61 () {54 vars in 931 bytes} [Mon Aug 22 19:13:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:13:15.210688 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:13:15.590028 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-ae90fe69-d43d-4be8-8904-82b2218d1cf8 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:13:15.610077 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-ae90fe69-d43d-4be8-8904-82b2218d1cf8 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403866 Aug 22 19:13:15.610605 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 32/64] 10.222.0.61 () {60 vars in 1292 bytes} [Mon Aug 22 19:13:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:13:15.632210 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG dbcounter [-] [105546] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:13:15.635901 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-97f2a5f5-4582-4567-b52d-192a9b8bd4dd admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:13:15.644596 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-97f2a5f5-4582-4567-b52d-192a9b8bd4dd admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013804 Aug 22 19:13:15.645107 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 33/65] 10.222.0.61 () {60 vars in 1283 bytes} [Mon Aug 22 19:13:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:13:15.656520 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-dc17d089-0bf1-42e4-9322-d6cb168c3fd3 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:13:15.664013 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-dc17d089-0bf1-42e4-9322-d6cb168c3fd3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010995 Aug 22 19:13:15.664524 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 33/66] 10.222.0.61 () {60 vars in 1286 bytes} [Mon Aug 22 19:13:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:13:15.675795 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:13:15.684282 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012245 Aug 22 19:13:15.684791 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 34/67] 10.222.0.61 () {60 vars in 1286 bytes} [Mon Aug 22 19:13:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:13:15.695938 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-513a9a94-36d1-49bb-ad50-753df087dbfb admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:13:15.703975 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-513a9a94-36d1-49bb-ad50-753df087dbfb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011445 Aug 22 19:13:15.704483 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 34/68] 10.222.0.61 () {60 vars in 1283 bytes} [Mon Aug 22 19:13:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:16:17.267384 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:16:17.268420 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 22 19:16:17.268811 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 35/69] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:16:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:16:17.409450 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_api:SELECT=6 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:16:17.571516 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-532ad19d-deb8-4da6-8f1f-e5abf505e17a admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:16:17.574101 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:16:17.574101 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: warnings.warn(msg) Aug 22 19:16:17.575221 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-532ad19d-deb8-4da6-8f1f-e5abf505e17a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:16:17.575797 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-532ad19d-deb8-4da6-8f1f-e5abf505e17a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:16:17.576303 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-532ad19d-deb8-4da6-8f1f-e5abf505e17a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:16:17.577082 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-532ad19d-deb8-4da6-8f1f-e5abf505e17a admin admin] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:16:17.577527 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-532ad19d-deb8-4da6-8f1f-e5abf505e17a admin admin] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:16:17.577943 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-532ad19d-deb8-4da6-8f1f-e5abf505e17a admin admin] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:16:17.611744 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-532ad19d-deb8-4da6-8f1f-e5abf505e17a admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.203723 Aug 22 19:16:17.612300 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 35/70] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Aug 22 19:16:17 2022] GET /compute/v2.1/os-services => generated 794 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:16:18.427625 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:16:18.428656 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 22 19:16:18.429047 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 36/71] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:16:18.618155 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-8c93a7c0-abf8-4b99-9b11-c643034cef3d admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:16:18.620550 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:16:18.620550 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: warnings.warn(msg) Aug 22 19:16:18.621634 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8c93a7c0-abf8-4b99-9b11-c643034cef3d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:16:18.622108 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8c93a7c0-abf8-4b99-9b11-c643034cef3d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:16:18.622526 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8c93a7c0-abf8-4b99-9b11-c643034cef3d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:16:18.623222 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8c93a7c0-abf8-4b99-9b11-c643034cef3d admin admin] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:16:18.623677 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8c93a7c0-abf8-4b99-9b11-c643034cef3d admin admin] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:16:18.624088 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8c93a7c0-abf8-4b99-9b11-c643034cef3d admin admin] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:16:18.643848 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-8c93a7c0-abf8-4b99-9b11-c643034cef3d admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076952 Aug 22 19:16:18.644408 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 36/72] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Aug 22 19:16:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:16:29.893705 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:16:29.894705 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 22 19:16:29.895095 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 37/73] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:16:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:16:30.037519 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_cell0:SELECT=4 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:16:30.038233 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_cell1:SELECT=4 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:16:30.039425 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG dbcounter [-] [105545] Writing DB stats nova_api:SELECT=8 {{(pid=105545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:16:30.086722 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-ed2a3536-6432-436e-8ff5-4ab74ff12af6 admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:16:30.089132 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:16:30.089132 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: warnings.warn(msg) Aug 22 19:16:30.090252 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-ed2a3536-6432-436e-8ff5-4ab74ff12af6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:16:30.090719 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-ed2a3536-6432-436e-8ff5-4ab74ff12af6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:16:30.091167 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-ed2a3536-6432-436e-8ff5-4ab74ff12af6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:16:30.091891 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-ed2a3536-6432-436e-8ff5-4ab74ff12af6 admin admin] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:16:30.092329 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-ed2a3536-6432-436e-8ff5-4ab74ff12af6 admin admin] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:16:30.092737 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-ed2a3536-6432-436e-8ff5-4ab74ff12af6 admin admin] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:16:30.117744 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-ed2a3536-6432-436e-8ff5-4ab74ff12af6 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084473 Aug 22 19:16:30.118218 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 37/74] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Aug 22 19:16:30 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:16:30.939871 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: DEBUG nova.api.openstack.wsgi [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] Calling method '>' {{(pid=105546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:16:30.940600 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: INFO nova.api.openstack.requestlog [None req-909bf778-fed0-4a47-bfef-a03d3e84cb05 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 22 19:16:30.940998 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: [pid: 105546|app: 0|req: 38/75] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Aug 22 19:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:16:31.133509 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG nova.api.openstack.wsgi [None req-8dfdf862-1e01-4aae-8c6e-879f9976748a admin admin] Calling method '>' {{(pid=105545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:16:31.135879 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:16:31.135879 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: warnings.warn(msg) Aug 22 19:16:31.136986 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8dfdf862-1e01-4aae-8c6e-879f9976748a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:16:31.137481 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8dfdf862-1e01-4aae-8c6e-879f9976748a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:16:31.137900 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8dfdf862-1e01-4aae-8c6e-879f9976748a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:16:31.138597 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8dfdf862-1e01-4aae-8c6e-879f9976748a admin admin] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:16:31.139034 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8dfdf862-1e01-4aae-8c6e-879f9976748a admin admin] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:16:31.139440 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: DEBUG oslo_concurrency.lockutils [None req-8dfdf862-1e01-4aae-8c6e-879f9976748a admin admin] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:16:31.161499 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: INFO nova.api.openstack.requestlog [None req-8dfdf862-1e01-4aae-8c6e-879f9976748a admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.081245 Aug 22 19:16:31.162015 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: [pid: 105545|app: 0|req: 38/76] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Aug 22 19:16:31 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 19:17:27.838857 dv-cinder-835384-22-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 22 19:17:27.839915 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: Mon Aug 22 19:17:27 2022 - graceful shutdown triggered... Aug 22 19:17:27.840362 dv-cinder-835384-22-iscsi devstack@n-api.service[105545]: Gracefully killing worker 1 (pid: 105545)... Aug 22 19:17:27.840739 dv-cinder-835384-22-iscsi devstack@n-api.service[105546]: Gracefully killing worker 2 (pid: 105546)... Aug 22 19:17:28.840187 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: worker 1 buried after 1 seconds Aug 22 19:17:28.840187 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: worker 2 buried after 1 seconds Aug 22 19:17:28.840844 dv-cinder-835384-22-iscsi devstack@n-api.service[105544]: goodbye to uWSGI. Aug 22 19:17:28.841744 dv-cinder-835384-22-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 22 19:17:28.842293 dv-cinder-835384-22-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 22 19:17:28.845076 dv-cinder-835384-22-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 19:17:28.856410 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 19:17:28 2022] *** Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: nodename: dv-cinder-835384-22-iscsi Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: machine: x86_64 Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: clock source: unix Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: pcre jit disabled Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: detected number of CPU cores: 4 Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: current working directory: / Aug 22 19:17:28.858245 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: detected binary path: /usr/bin/uwsgi-core Aug 22 19:17:28.859018 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: your processes number limit is 47680 Aug 22 19:17:28.859018 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: your memory page size is 4096 bytes Aug 22 19:17:28.859018 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: detected max file descriptor number: 2048 Aug 22 19:17:28.859018 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: lock engine: pthread robust mutexes Aug 22 19:17:28.859018 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: thunder lock: enabled Aug 22 19:17:28.859018 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 19:17:28.859018 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 19:17:28.898341 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: Python main interpreter initialized at 0x55bd587689c0 Aug 22 19:17:28.898341 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: python threads support enabled Aug 22 19:17:28.898341 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: your server socket listen backlog is limited to 100 connections Aug 22 19:17:28.898341 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: your mercy for graceful operations on workers is 90 seconds Aug 22 19:17:28.898815 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 19:17:28.898815 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: *** Operational MODE: preforking *** Aug 22 19:17:28.899039 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: *** uWSGI is running in multiple interpreter mode *** Aug 22 19:17:28.899039 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: spawned uWSGI master process (pid: 120624) Aug 22 19:17:28.899244 dv-cinder-835384-22-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 19:17:28.899836 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: spawned uWSGI worker 1 (pid: 120639, cores: 1) Aug 22 19:17:28.900664 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: spawned uWSGI worker 2 (pid: 120640, cores: 1) Aug 22 19:17:28.900664 dv-cinder-835384-22-iscsi devstack@n-api.service[120624]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 19:17:29.556759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 19:17:29.558553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 19:17:30.710145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:17:30.710145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: from cryptography.utils import int_from_bytes Aug 22 19:17:30.711196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:17:30.711196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: from cryptography.utils import int_from_bytes Aug 22 19:17:30.714023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:17:30.714023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: from cryptography.utils import int_from_bytes Aug 22 19:17:30.714500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:17:30.714500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: from cryptography.utils import int_from_bytes Aug 22 19:17:33.124679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 19:17:33.125120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 19:17:33.125484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 19:17:33.125854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 19:17:33.126119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 19:17:33.126508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.127041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.127373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.127726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.128222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.128542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.128873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.129205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.129555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.129824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.130145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.130475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-22-iscsi {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.130800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.131110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.131423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.131775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.132089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.132416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.132728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.133232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.134695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.134695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.134695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.134695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.134999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.135234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.135562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.136429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.136764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.137073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.137482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-22-iscsi {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.137806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.138115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.138426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.138844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.139168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.139470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.139821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.140162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.140479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.140804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.141184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.141464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.141789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.142083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.142399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.142705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.143029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.143338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.143734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.143924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.144237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.144578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.144878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.145210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.145466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.145721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.146045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.146373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.146689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.147000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.147309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.147620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.147972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.148284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.148595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.148903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.149224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.149546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.149875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.150705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.150705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.150956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.151138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.151506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.152391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.152723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.153037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.153361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.153687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.154000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.154312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.154594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 19:17:33.154987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.155064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 19:17:33.155135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.155322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.155563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.155821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 19:17:33.155932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.156157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.156324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 19:17:33.156472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.156706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 19:17:33.156817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.157090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.157205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.157401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.157574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.157746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.157891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.158033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.158175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.158330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.158598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.158771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.158914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.159057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.159197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.159352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.159505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.159682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.159832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.159974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.160126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.160268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.160424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.160573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.160714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.160862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-22-iscsi {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.161004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.161166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.161315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.161477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.161626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.161768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.161909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.162059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.162202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.162350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.162500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.163071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.163247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.163687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.163862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.163862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.164142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.164304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.164453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.164601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.164754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.164908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.165058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.165211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.165362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.165513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.165654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.165807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.165948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.166096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.166096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.166373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.166513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.166667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.166819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.166819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.167168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.167325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.167488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.167636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.167823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.168046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.168210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-22-iscsi {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.168369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.168523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.168693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.168844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.168994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.169135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.169292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.169435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.169626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.169780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.169921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.170069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.170219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.170360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.170503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.170650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.170800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.170947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.171159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.171314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.171465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.171626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.171831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.171984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.172133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.172282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.172424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.172573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.172715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.172885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.173205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.173364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.173508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.173661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.173803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.173961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.174111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.174259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.174400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.174553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.174708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.174850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.174990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.175137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.175287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.175428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.175587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.175766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.175921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.176063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.176202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.176359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.176509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.176653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.176912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.177070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.177259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.177432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.177588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.177730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.177896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.178053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.178285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.178459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.178613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.178755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.178897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.179038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.179187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.179338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.179489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.179631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.179858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.180002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.180156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.180404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.180551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.180692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.180839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.180988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.181142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.181284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.181435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.181576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.181717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.181865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.182017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.182167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.182307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.182447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.182597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.182810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.182973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.183144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.183368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.183626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.183806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.183963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.184104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.184247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.184395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.184536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.184687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.184837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.184986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.185127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.185277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.185425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.185588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.185745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.185886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.186026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.186165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.186313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.186454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.186604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.186754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.186896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.187260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.187426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.187579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.187809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.187955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.188097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.188262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.188486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.188655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.188799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.188941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.189096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.189240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.189393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.189548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.189698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.189860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.190010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.190149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.190297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.190452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.190594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.190744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.190885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.191032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.191173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.191329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.191486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.191670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.191831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.191973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.192122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.192263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.192416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.192560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.192702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.192850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.192992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.193145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.193293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.193531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.193799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.193959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.194111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.194264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.194413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.194554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.194722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.194877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.195019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.195161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.195301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.195442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.195600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.195799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.195950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.196099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.196245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.196395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.196603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.196755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.196927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.197086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.197275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.197523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.197747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.197894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.198056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.198205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.198962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.199128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.199283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.199433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.199575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.199759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.199906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.200056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.200298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.200446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.200597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.200747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.200896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.201051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.201193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.201399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.201555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.201705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.201846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.202001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.202151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.202301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.202443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.202600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.202751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.202894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.203036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.203176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.203317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.203465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.203744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.203999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:17:33.204155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.204155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.204448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.204591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.204751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.204895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.205035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.205184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.205333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.205541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.205702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.205855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.206005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.206148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.206297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.206452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.206452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.206748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.206949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.207266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.207628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.208047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.208312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.208625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.208889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.209119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.209267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.209418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.209572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.209743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.209896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.210039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.210187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.210343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.210514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.210665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.210841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.210997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.211148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.211298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.211449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.211591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.211778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.211922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.212080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.212257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.212414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.212596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.212754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.212923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.213095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.213260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.213420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.213604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.213832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.214620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.214781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.214924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.215074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.215223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.215365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.215519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.215732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.215882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.216035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.216187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.216336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.216631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.217013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.217274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.217424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.218725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.218864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.218967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.219918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.220194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.220307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.220392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.220473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.220699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.220801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.221009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.221118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.221327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.221436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.221640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.221751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.221950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.222051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.222257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.222358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.222573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.222688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.222898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.222999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.223215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.223315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.223543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.223687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.223894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.224008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.224206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.224307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.224516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.224690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.224850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.224997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.225143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.225551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.225704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.225916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.226078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.226233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.226387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.226542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.226696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.226852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.227007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.227154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.227299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.227444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.227589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.227793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.227960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.228112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.228259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.228405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.228596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.228799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.228959 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.229107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.229253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.229406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.229593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.229746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.229903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.230057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.230212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.230358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.230565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.230721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.230874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.231028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.231175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.231329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.231486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.232038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.232198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.232358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.232512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.232674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.232828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.232982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.233136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.233282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.233436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.233595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.233750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.233896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.234041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.234194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.234194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.234502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.234658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.234804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.234949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.235094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.235253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.235400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.235554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.235730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.235937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.236099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.236270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.236425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.236572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.236724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.236871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.237015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.237169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.237325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.237472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.237617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.237775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.237922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.238068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.238230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.238377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.238531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.238687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.238834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.238987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.239141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.239295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.239450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.239605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.239836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.239992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.240144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.240307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.240473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.240473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.240768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.240929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.241082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.241241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.241403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.241563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.241741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.242336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.242499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.242666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.242833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.242994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.243154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.243306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.243467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.243630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.243821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.243984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.244144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.244298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.244451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.244612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.244780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.244935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.245101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.245294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.245450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.245622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.245776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.245935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.246133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.246288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.246455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.246609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.246769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.246933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.247087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.247247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.247414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.248074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.248239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.248404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.248565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.248718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.248879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.249032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.249032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.249322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.249492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.249645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.249812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.249966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.250126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.250287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.250440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.250606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.250760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.250919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.251105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.251275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.251430 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.251603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.251783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.252377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.252543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.252696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.252850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.253022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.253177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.253339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.253493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.253654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.253821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.253993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.254147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.254147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.254440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.254601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.254763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.254931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.255084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.255286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.255453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.255624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.255869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.256034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.256249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.256404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.256566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.256719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.256881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.257036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.257197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.257356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.257518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.257686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.257848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.258002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.258154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.258317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.258469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.258636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.258797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.258951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.259110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.259271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.259424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.259584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.259776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.259931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.260084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.260251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.260429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.260597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.261261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.261427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.261579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.261734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.261942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.262525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.262689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.262853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.263008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.263160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.263327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.263492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.263675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.263852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.264013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.264173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.264173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.264545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.264697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.264850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.265591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.265758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.265923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.266110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.266315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.266477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.266639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.266794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.266962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.267117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.267270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.267438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.268234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.268404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.268558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.268730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.268894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.269050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.269203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.269607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.269778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.269932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.270096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.270252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.270406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.270565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.270719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.270898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.271054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.271208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.271369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.271522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.271695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.271872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.272035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.272208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.272923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.273081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.273242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.273495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.273680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.273844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.274006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.274170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.274326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.274488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.274642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.274795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.274954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.275108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.275280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.275436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.275590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.275866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.276040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.276205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.276473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.277129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.277291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.277291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.277592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.277745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.277911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.278072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.278236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.278390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.278567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.278729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.278729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.279029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.279183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.279343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.279505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.279699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.279861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.280014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.280187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.280342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.280506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.280676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.280831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.280992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.281146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.281307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.281467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.281629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.282005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.282178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.282346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.283613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.283852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.284036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.284332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.284500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.284669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.284827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.284981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.285142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.285296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.285448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.285615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.285776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.285938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.286102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.286277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.286469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.286634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.286812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.287106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.287278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.287433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.287609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.287609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.288101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.288277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.288434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.288587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.288761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.288915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.289078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.289078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.289370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.289530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.289697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.289869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.290158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.290333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.290497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.290653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.290827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.290990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.291144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.291304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.291465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.291628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.291840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.292027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.292199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.292353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.292512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.293111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.293281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.293462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.293625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.293786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.293947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.293947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.294264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.294419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.294578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.294739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.294892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.295059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.295213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.295377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.295554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.295729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.295902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.296068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.296222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.296376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.296529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.296682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.296845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.297006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.297255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.297425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.297591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.297753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.297917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.298078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.298239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.298400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.298554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.298706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.298867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.299022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.299175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.299327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.299481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.299771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.299935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.300100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.300100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.300391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.300391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.300705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.300859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.301012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.301171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.301331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.301492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.302290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.302450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.302613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.302794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.302978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.303468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.303826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.303985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.304122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.304264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.304413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.304549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.304691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.304826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.304960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.305092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.305235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.305369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.305502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.305635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.305906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.306057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.306272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.306409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.306543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.306677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.306810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.307829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.307974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.308118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.308283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.308438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.308592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.308756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.308920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.308920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.309229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.309383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.309565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.309730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.309893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.310055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.310214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.310368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.310521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.310686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.310848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.311002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.311162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.311322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.311484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.311682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.311845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.311998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.312152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.312304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.312474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.312629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.312784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.312937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.313098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.313657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.314376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.314550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.314706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.314859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.315012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.315185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.315537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.315737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.315911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.316063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.316287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.316529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.316686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.317036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.317179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.317179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.317417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.317417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.317707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.317934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.318196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.318761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.318914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.319686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.321941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.323068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.323186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.324285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.324440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.324578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.324714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.324714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.324946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.325075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.325199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.325323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.325438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.325560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.325684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.325820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.325955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.326099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.326369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.327148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.327292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.327429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.327563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.327944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.328266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.328396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.328530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.328680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.328804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.328938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.329080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.329203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.329327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.329442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.329557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.329678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.329802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.329926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.330050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.330302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.330452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.330690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.330690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.331009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.331135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.331249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.331381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.331515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.331654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.331798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.331916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.332550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.333530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.333647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.333785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.333926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.334303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.334454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.334454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.334709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.334843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.334983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.334983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.335384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.335525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.335748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.335886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.336020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.336165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.336311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.336455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.336589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.336722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.336854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.336997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.337139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.337284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.337425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.337560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.337693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.337841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.337984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.338131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.338288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.338288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.338288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.338288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.338905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.339556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.339707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.339843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.339989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.340133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.340268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.340410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.340545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.340545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.340806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.340948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.341082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.341223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.341357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.341490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.341637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.341771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.341904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.342044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.342186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.342319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.342462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.342596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.342729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.342869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.343003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.343144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.343291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.343432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.343576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.343725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.343872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.344017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.344374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.344374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.344659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.344794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.344928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.345071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.345205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.345360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.345585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.345725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.345858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.346002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.346136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.346277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.346419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.346554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.346696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.346850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.347001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.347137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.347269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.347403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.347545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.347713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.347863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.347999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.348144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.348274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.348417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.348631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.348778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.348912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.348912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.349173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.349320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.349456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.349588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.349721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.349855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.349996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.350139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.350519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.350667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.350808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.350943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.351089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.351223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.351356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.351488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.351621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.351770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.351924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.352059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.352200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.352348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.352491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.352626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.352768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.352902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.353037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.353177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.353311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.353443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.353585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.353891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.354017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.354017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.354263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.354640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.354904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.355050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.355184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.355476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.355924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.356071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.356214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.356356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.356520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.356650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.356765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.356887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.357003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.357131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.357255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.357404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.357559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.357705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.357954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.358101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.358356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.358503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.358738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.358869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.359002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.359134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.359340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.359340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.359340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.359340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.359340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.360014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.360141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.360285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.360542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.360700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.360949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.361089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.361205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.361340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.361480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.361603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.361742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.361885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.362019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.362134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.362263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.362380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.362513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.362654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.362789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.363036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.363036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.363408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.363550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.363756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.363894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.364015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.364147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.364268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.364404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.364771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.364918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.365053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.365197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.365339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.365485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.365620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.365743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.365898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.366120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.366120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.366399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.366542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.366687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.366829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.366964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.367106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.367247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.367391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.367525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.367683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.367819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.367967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.368104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.368238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.368371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.368493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.368632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.368794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.368994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.369138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.369272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.369413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.369556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.369703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.369840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.369973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.370114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.370279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.370423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.370557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.370690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.370825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.370966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.371108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.371255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.371255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.371510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.371677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.371814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.371947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.372104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.372248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.372389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.372524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.372657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.372799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.372949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.373083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.373216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.373349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.373482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.373625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.373759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.373892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.374026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.374166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.374307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.374451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.374451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.374915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.375054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.375177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.375310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.375458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.375592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.375742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.375889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.376025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.376181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.376399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.376544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.376679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.376813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.376961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.377106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.377247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.377384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.377525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.377659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.377806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.377941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.378074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.378215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.378350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.378491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.378634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.378773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.378913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.379123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.379252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.379399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.379543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.379693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.379828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.379974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.380116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.380253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.380395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.380529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.380680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.380824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.380958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.381105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.381239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.381373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.381514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.381650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.381783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.381925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.382060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.382193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.382328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.382461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.382602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.382746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.382746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.383010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.383145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.383277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.383425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.383561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.383732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.383868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.384002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.384135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.384282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.384428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.384570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.384713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.385057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.385197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.385341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.385478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.385611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.385745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.386413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.386632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.386855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.386999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.387134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.387268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.387401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.387548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.387698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.387861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.388088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.388245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.388388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.388538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.388674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.388807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.388948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.388948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.389287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.389435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.389572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.389784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.389940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.390084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.390231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.390373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.390515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.390659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.390804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.390938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.391080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.391222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.391363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.391496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.391629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.391791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.391940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.392075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 19:17:33.392210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.392210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.392210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.392210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.392210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.392210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.392210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.392210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.393202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.393202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.393202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.393202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.393202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.393202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.393202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.394103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.394103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.394103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.394498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.394498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.394750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.395049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.395366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.395692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.396007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.396318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.396646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.396954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.397310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.397630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.397942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.398270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.398585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.398907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.399257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.399580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.400271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.400565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.400891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.401230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.402107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.402484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.402738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.403050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.403382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.403718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.404039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.404357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.404673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.404989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.405307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.405621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.406174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.406291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.406544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.407048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.407368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.407709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.408026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.408345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.408698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.409027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.409428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.409673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.409994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.410309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.410624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.410943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.411259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.411580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.411943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.412266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.412578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.413009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.413326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.413653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.413977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.414291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.414616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.414945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.415392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.415592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.415943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.416363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.416728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.417091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.417421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.417785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.418035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.418341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.418655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.418983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.419300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.419609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.419940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.420253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.420560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.420866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.421176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.421483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.421793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.422103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.422411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.422720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.423025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.423335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.423638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.424149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.424462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.424771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.425081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.425517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.425682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.426023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.426361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.426684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.427011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.427327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.427678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.427990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.428317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.428643 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.428968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.429282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.429623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.429960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.430279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.430597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.430913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.431231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.431545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.431906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.432240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.432549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.432897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.433228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.433535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.433856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.434173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.434506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.434827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.435222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.435456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.435807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.436125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.436447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.436830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.437077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.437400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.437746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.438081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.438413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.438732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.439062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.439396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.439772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.440093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.440440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.440775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.441096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.441411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.441721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:17:33.441984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 19:17:33.452731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO dbcounter [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Registered counter for database nova_api Aug 22 19:17:33.473409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_db.sqlalchemy.engines [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:17:33.480257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writer thread running {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:17:33.504843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO dbcounter [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Registered counter for database nova_api Aug 22 19:17:33.525037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:17:33.531517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:17:33.536229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.context [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b396f6b-723e-4dee-83de-557019f2714f(cell1) {{(pid=120639) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 19:17:33.540286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:17:33.540769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:17:33.542395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:17:33.543139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:17:33.543595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:17:33.545598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:17:33.547580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO dbcounter [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Registered counter for database nova_cell0 Aug 22 19:17:33.551567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO dbcounter [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Registered counter for database nova_cell1 Aug 22 19:17:33.559288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_db.sqlalchemy.engines [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:17:33.561674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_db.sqlalchemy.engines [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:17:33.568286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writer thread running {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:17:33.568750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writer thread running {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:17:33.587658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.context [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b396f6b-723e-4dee-83de-557019f2714f(cell1) {{(pid=120640) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 19:17:33.591850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:17:33.592341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:17:33.594044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:17:33.594790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:17:33.595298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:17:33.597368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:17:33.599495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO dbcounter [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Registered counter for database nova_cell0 Aug 22 19:17:33.603911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO dbcounter [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Registered counter for database nova_cell1 Aug 22 19:17:33.611271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:17:33.613450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:17:33.619088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:17:33.620911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:17:33.715955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO dbcounter [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Registered counter for database nova_cell0 Aug 22 19:17:33.723757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_db.sqlalchemy.engines [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:17:33.728396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writer thread running {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:17:33.768303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO dbcounter [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Registered counter for database nova_cell0 Aug 22 19:17:33.774959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:17:33.782646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:17:34.045174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: WARNING keystonemiddleware.auth_token [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 19:17:34.053102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: WARNING keystonemiddleware.auth_token [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 19:17:34.099524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 19:17:34.107712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 19:17:34.411134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: WARNING keystonemiddleware.auth_token [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 19:17:34.418719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: WARNING keystonemiddleware.auth_token [None req-8baddb62-b7d4-4e32-a5ed-e126d40f44b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 19:17:34.424585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd587689c0 pid: 120639 (default app) Aug 22 19:17:34.459237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 19:17:34.465950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-b64a1bb2-8e11-482a-9622-1c557f3b0f32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 19:17:34.471287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bd587689c0 pid: 120640 (default app) Aug 22 19:18:13.225250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7c8ee16e-edc2-4482-888f-e4b297fe3ae2 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e58341f0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:13.279201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=3 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:13.280383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=3 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:13.281876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=3 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:13.283226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=3 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:13.871584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7c8ee16e-edc2-4482-888f-e4b297fe3ae2 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/29c69eb0-8aa1-4c0a-8821-941fa2e3ae01" status: 200 len: 350 microversion: 2.1 time: 1.138539 Aug 22 19:18:13.872347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1/1] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:18:12 2022] GET /compute/v2.1/os-volumes/29c69eb0-8aa1-4c0a-8821-941fa2e3ae01 => generated 350 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:15.882046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:15.883591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:15.884535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:15.890354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:16.343033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8694c148-b6aa-4463-8414-791a3866ec9f tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e57521f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:17.427627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8694c148-b6aa-4463-8414-791a3866ec9f tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4fd08fc8-933f-4969-a8a5-b2c6789bd959" status: 200 len: 350 microversion: 2.1 time: 1.550625 Aug 22 19:18:17.443701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1/2] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:18:15 2022] GET /compute/v2.1/os-volumes/4fd08fc8-933f-4969-a8a5-b2c6789bd959 => generated 350 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:24.518476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-705032832", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "networks": [{"uuid": "aab07dfd-389d-4d21-b572-666272593c85"}]}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:24.641462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2ad0386-4c57-48ea-b29c-32d22d39b711 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: .version_select at 0x7f66e5617430>, body: {"keypair": {"name": "tempest-keypair-1680529348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/GAr+wTLF7O0KqrcfyuE7Xk3QPGYct5r6vhQtahc6nU/L/SON6mR973xP9n5cDvgK+RV2qiKQO9Pi8MkGG+/dRxXC28kCpcNwlPIjgumFt1iJtTpw46zGbx0lfcuC0og=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:24.771157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-c2ad0386-4c57-48ea-b29c-32d22d39b711 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:18:24.789477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-c2ad0386-4c57-48ea-b29c-32d22d39b711 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for user 61388384a318473e987ab06426509b69 and project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:18:24.818039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] validate_networks() for [('aab07dfd-389d-4d21-b572-666272593c85', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:18:24.912154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2ad0386-4c57-48ea-b29c-32d22d39b711 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.507821 Aug 22 19:18:24.913283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2/3] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 19:18:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:25.156208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-804b65f9-83c7-4665-8d40-2a780ac1d071 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Action: 'create', calling method: .version_select at 0x7f66e554c1f0>, body: {"keypair": {"name": "tempest-keypair-476774537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2yEeGnQXIJNTBX2viBciGjho66VZVmTfEh3Da47ecuYFV2QIZYBRYfWl5tMfG31iWfnQElci3ovCquRB+YRcT12GlSCGXa0U9UpDrE5s5QwL4u2KwfDVIpgbfXb1tZGw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:25.192662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-804b65f9-83c7-4665-8d40-2a780ac1d071 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Getting quotas for project ca75caa807b445f486899173277b5051. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:18:25.202042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-804b65f9-83c7-4665-8d40-2a780ac1d071 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Getting quotas for user 21d0ab6d1a724547b8c643287df897da and project ca75caa807b445f486899173277b5051. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:18:25.271443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-804b65f9-83c7-4665-8d40-2a780ac1d071 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.308783 Aug 22 19:18:25.272568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3/4] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 19:18:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:25.388641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1527639695", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:25.539006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] validate_networks() for [('11651de2-775a-4c1f-bdbd-479e25707d74', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:18:26.789309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:18:26.790573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:18:26.791294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:18:26.791895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:18:26.792504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:18:26.819762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:26.820267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:26.827398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:26.828588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:26.829595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:26.830200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:26.923124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Getting quotas for project ae986c6b484740a9a4629648d1b65e51. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:18:26.940183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Getting quotas for user 942c420f56f5449fbae8b4ff780d1834 and project ae986c6b484740a9a4629648d1b65e51. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:18:26.972019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:18:26.978098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:18:27.203440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b0c52492-d2f2-47ce-84ba-ec0f372ee2da tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.553753 Aug 22 19:18:27.204167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 2/5] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:18:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:18:27.209320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ffa39aab-7c58-4bdc-91f9-70f1485dd623 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e4cfd040>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:27.400734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ffa39aab-7c58-4bdc-91f9-70f1485dd623 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/ffeb7aaa-7973-45ec-8701-f4961718bff7" status: 200 len: 351 microversion: 2.1 time: 0.195219 Aug 22 19:18:27.402004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 3/6] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:18:27 2022] GET /compute/v2.1/os-volumes/ffeb7aaa-7973-45ec-8701-f4961718bff7 => generated 351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:27.416067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-66f84a05-9e43-46bd-bc7d-007ba187054f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:27.416859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-66f84a05-9e43-46bd-bc7d-007ba187054f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:27.863015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:18:27.863610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:18:27.864312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:18:27.865149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:18:27.865739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:18:27.922831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:27.923344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:27.942741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:27.943738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:27.950926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:27.951484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:28.062495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Getting quotas for project 0e3308fc667c4b8c8552e27ba69d40fc. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:18:28.070303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Getting quotas for user 8030a8ebdd8c45c7bd30403c866a9278 and project 0e3308fc667c4b8c8552e27ba69d40fc. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:18:28.102085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:18:28.117310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:18:28.243590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b31dd01-d025-47b0-992f-6fb64a094eaa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.969642 Aug 22 19:18:28.245302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 4/7] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:18:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:18:28.258768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf6f176a-765a-4269-88dc-b859bef6b441 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e4ca05e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:28.421637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-66f84a05-9e43-46bd-bc7d-007ba187054f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:28.462573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf6f176a-765a-4269-88dc-b859bef6b441 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.214970 Aug 22 19:18:28.472081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 5/8] 10.222.0.61 () {58 vars in 1134 bytes} [Mon Aug 22 19:18:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:28.472081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7336dea3-0822-4ca2-af69-8d7908c8c2dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:28.472081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7336dea3-0822-4ca2-af69-8d7908c8c2dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:28.482786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-66f84a05-9e43-46bd-bc7d-007ba187054f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1214 microversion: 2.1 time: 1.079279 Aug 22 19:18:28.483296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 4/9] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:27 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1214 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:28.493673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fcb64782-27d0-4095-b6ac-92c5425d61d9 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e44915e0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:28.731334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fcb64782-27d0-4095-b6ac-92c5425d61d9 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.243088 Aug 22 19:18:28.732693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 5/10] 10.222.0.61 () {58 vars in 1149 bytes} [Mon Aug 22 19:18:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:28.749100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-aa4d1035-2c09-4ff0-b280-85e911ce265a tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e44aa430>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:28.785939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7336dea3-0822-4ca2-af69-8d7908c8c2dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:28.818665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7336dea3-0822-4ca2-af69-8d7908c8c2dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1222 microversion: 2.1 time: 0.353705 Aug 22 19:18:28.819271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:28 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1222 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:28.949228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1898350440", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:29.146561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] validate_networks() for [('11651de2-775a-4c1f-bdbd-479e25707d74', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:18:29.179983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-aa4d1035-2c09-4ff0-b280-85e911ce265a tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.436346 Aug 22 19:18:29.188806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1134 bytes} [Mon Aug 22 19:18:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:29.194030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-11c79458-9158-4743-a25d-c19cfc859aa9 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e44a6820>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:29.488425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-11c79458-9158-4743-a25d-c19cfc859aa9 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.297997 Aug 22 19:18:29.490186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1167 bytes} [Mon Aug 22 19:18:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:18:29.504321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-feeb1efb-0dd5-4ffb-bd58-9b041ef31154 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e4d001f0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:29.716423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-feeb1efb-0dd5-4ffb-bd58-9b041ef31154 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.216426 Aug 22 19:18:29.718061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 8/14] 10.222.0.61 () {58 vars in 1170 bytes} [Mon Aug 22 19:18:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:18:29.732806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-86ec57e4-09ae-4bfb-9846-4d0d41c8853c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:29.733747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-86ec57e4-09ae-4bfb-9846-4d0d41c8853c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:29.888736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-86ec57e4-09ae-4bfb-9846-4d0d41c8853c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:29.898893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-86ec57e4-09ae-4bfb-9846-4d0d41c8853c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1214 microversion: 2.1 time: 0.179525 Aug 22 19:18:29.923843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 9/15] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:29 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:29.935130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-48626d35-3e2a-498d-9708-fbf29a3cf4e4 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e4d005e0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:30.175978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-48626d35-3e2a-498d-9708-fbf29a3cf4e4 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.250810 Aug 22 19:18:30.176647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 10/16] 10.222.0.61 () {58 vars in 1155 bytes} [Mon Aug 22 19:18:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:30.195744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1440238891", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72f2b4fb-f148-44f1-907b-babe480eca91"}], "security_groups": [{"name": "tempest-securitygroup--121329591"}], "key_name": "tempest-keypair-476774537", "user_data": "}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:31.081404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] validate_networks() for [('72f2b4fb-f148-44f1-907b-babe480eca91', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:18:31.208257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:18:31.209262 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:18:31.209924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:18:31.210533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:18:31.211150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:18:31.240271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:31.241056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:31.241660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:31.245028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:31.246606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:31.250813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:31.307337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Getting quotas for project 0e3308fc667c4b8c8552e27ba69d40fc. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:18:31.319308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Getting quotas for user 8030a8ebdd8c45c7bd30403c866a9278 and project 0e3308fc667c4b8c8552e27ba69d40fc. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:18:31.351387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:18:31.358045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:18:31.480964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ebb30b99-43a3-4d34-a7d2-8b0f9fb066da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.537394 Aug 22 19:18:31.481620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 7/17] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:18:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 19:18:31.505817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8fc7a9b0-04db-4d9e-a423-a3407f77da5c tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e44449d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:31.901037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8fc7a9b0-04db-4d9e-a423-a3407f77da5c tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.412904 Aug 22 19:18:31.910012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 8/18] 10.222.0.61 () {58 vars in 1188 bytes} [Mon Aug 22 19:18:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:31.926942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:31.927561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:31.971323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:31.978178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:31.981395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:31.983359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:31.987507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:31.990025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:32.469150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:32.483087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6bd2f1b0-4d42-449b-8788-0cb190320903 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1272 microversion: 2.1 time: 0.571904 Aug 22 19:18:32.484248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 9/19] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:31 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1272 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:32.495768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c302dc9-6e7d-4b5e-a3d7-675b283c061d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:32.496530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c302dc9-6e7d-4b5e-a3d7-675b283c061d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:32.653663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c302dc9-6e7d-4b5e-a3d7-675b283c061d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:32.664606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c302dc9-6e7d-4b5e-a3d7-675b283c061d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1222 microversion: 2.1 time: 0.179117 Aug 22 19:18:32.667431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 10/20] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:32 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:32.678806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7a93025-4468-4db7-b96d-53119bbdec99 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] Calling method '.version_select at 0x7f66e43f04c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:32.745253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:18:32.748642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:18:32.749163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:18:32.750968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:18:32.751375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:18:32.782324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:32.782822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:32.783260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:32.784014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:32.786205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:32.789513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:32.850625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Getting quotas for project ca75caa807b445f486899173277b5051. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:18:32.862132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Getting quotas for user 21d0ab6d1a724547b8c643287df897da and project ca75caa807b445f486899173277b5051. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:18:32.890451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:18:32.892912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:18:32.895630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7a93025-4468-4db7-b96d-53119bbdec99 tempest-VolumesTestJSON-641932642 tempest-VolumesTestJSON-641932642-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.226869 Aug 22 19:18:32.896681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 11/21] 10.222.0.61 () {58 vars in 1155 bytes} [Mon Aug 22 19:18:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:32.902513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-644373627", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b9dcfeb-0136-4b6f-b975-7fb15dd06c27"}], "security_groups": [{"name": "tempest-securitygroup--397008119"}], "key_name": "tempest-keypair-1680529348", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:33.023307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-943da3e1-d773-4db1-bb27-b57aef4c5a92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.836334 Aug 22 19:18:33.029692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 11/22] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:18:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:18:33.035003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b26c892f-1a45-4d02-b96a-7845e6ac4f94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:33.036146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b26c892f-1a45-4d02-b96a-7845e6ac4f94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:33.441993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] validate_networks() for [('0b9dcfeb-0136-4b6f-b975-7fb15dd06c27', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:18:33.511840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b26c892f-1a45-4d02-b96a-7845e6ac4f94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:33.534075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b26c892f-1a45-4d02-b96a-7845e6ac4f94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1237 microversion: 2.1 time: 0.499049 Aug 22 19:18:33.535511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 12/23] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:33 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1237 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:33.572047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:33.576541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:33.602907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:33.603688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:33.604472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:33.605759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:33.606575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:33.607198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:34.144267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:34.174447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d4af9929-94c3-4271-a2b2-a7d78d0c4b87 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1272 microversion: 2.1 time: 0.623261 Aug 22 19:18:34.195741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 13/24] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:33 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1272 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:34.229372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:34.230576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:34.263900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:34.272386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:34.273398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:34.275714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:34.277534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:34.277994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:34.908886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:34.922734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f6033141-9d5e-4f27-93c1-a6e67f3d17be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1280 microversion: 2.1 time: 0.723936 Aug 22 19:18:34.925689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 14/25] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:34 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1280 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:34.950461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:34.951137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:34.966902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:34.970509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:34.971039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:34.972855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:34.973491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:34.975947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:35.217535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:35.236359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-69d8a989-123f-46af-9b5d-fd4710065a3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1289 microversion: 2.1 time: 0.309319 Aug 22 19:18:35.242018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 15/26] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1289 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:35.252611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:35.253330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:35.263396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:35.302160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:35.314808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:35.320782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:35.324665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:35.325325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:35.572768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:18:35.573382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:18:35.574623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:18:35.575329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:18:35.576133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:18:35.603011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:35.604648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:35.620063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:35.623140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:35.626409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:35.630290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:35.735548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:18:35.746822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for user 61388384a318473e987ab06426509b69 and project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:18:35.787733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:18:35.801615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:18:35.998650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-115fdbfe-71a4-479f-92b4-80f297bdfe26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.100504 Aug 22 19:18:36.003684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 12/27] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:18:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 3106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:18:36.022502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:36.024275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:36.041966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:36.045350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:36.046777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:36.050018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:36.051422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:36.052354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:36.582267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:36.611805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4d0a1cf6-0068-4477-b6b5-f04602bf6d07 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 1.367422 Aug 22 19:18:36.617500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 16/28] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:35 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:36.638405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dbf21dc6-24c7-40d6-8211-5f84e5b93fe6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:36.642518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dbf21dc6-24c7-40d6-8211-5f84e5b93fe6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:36.890973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dbf21dc6-24c7-40d6-8211-5f84e5b93fe6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:36.909270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dbf21dc6-24c7-40d6-8211-5f84e5b93fe6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1241 microversion: 2.1 time: 0.288543 Aug 22 19:18:36.912298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 17/29] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1241 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:36.924816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:36.925634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:36.944223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:36.944737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:36.950574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:36.951779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:36.952337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:36.952821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:37.054181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:37.068534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f61b1f9b-39cf-48f7-a323-a6c202cb6812 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1280 microversion: 2.1 time: 1.062499 Aug 22 19:18:37.084941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 13/30] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:36 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1280 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:37.142254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:37.157164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-962d96a3-e71f-4408-8b68-562be3f6951d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1295 microversion: 2.1 time: 0.238004 Aug 22 19:18:37.157809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 18/31] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1295 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:37.641542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:37.642760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:37.658321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:37.680967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:37.681436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:37.682193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:37.700137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:37.700870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:37.936772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:37.936772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:37.952990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:37.955213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:37.956717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:37.962494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:37.963470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:37.965075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:38.205376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:38.221403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3188e5a-4519-4a37-9adb-7c764c022f9c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.583596 Aug 22 19:18:38.222012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 14/32] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:37 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:38.250987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:38.253882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:38.273683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:38.274105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:38.282012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:38.287618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:38.288429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:38.289053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:38.406556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:38.423154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b791de78-6e81-41fb-83ce-4b4d774602fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1293 microversion: 2.1 time: 0.494524 Aug 22 19:18:38.429623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 19/33] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:37 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1293 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:38.452445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:38.454019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:38.488920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:38.495239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:38.496710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:38.498045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:38.498679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:38.499904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:39.087175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:39.121008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:39.148744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc40be5b-65b4-4b16-8f3e-5424fcb75d90 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1280 microversion: 2.1 time: 0.910031 Aug 22 19:18:39.166756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 15/34] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:38 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1280 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:39.177994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-88bca649-38eb-48b1-a5ad-6b25f140ab9b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1295 microversion: 2.1 time: 0.704211 Aug 22 19:18:39.182021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 20/35] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1295 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:39.250530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:39.251935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:39.280755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:39.294856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:39.295608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:39.303589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:39.304444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:39.305097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:39.458774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:39.459826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:39.473464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:39.476257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:39.477221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:39.485100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:39.485950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:39.486629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:39.820746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:39.840870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d4d754f3-f79d-450c-9db9-af0ab7ced882 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1299 microversion: 2.1 time: 0.386397 Aug 22 19:18:39.845629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 21/36] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1299 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:40.189130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:40.190653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:40.205355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:40.206611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:40.208118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:40.210298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:40.211941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:40.214681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:40.226386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:40.244069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0626c219-78db-459b-a6e1-59e0d286bb8f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.995603 Aug 22 19:18:40.248822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 16/37] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:39 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:40.277184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:40.277880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:40.309798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:40.317334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:40.320032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:40.326022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:40.330473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:40.333291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:40.910946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:40.922208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8bb71575-69f5-43bf-92c3-29525ab6412c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.739294 Aug 22 19:18:40.924293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 22/38] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:40 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:40.940692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:40.941666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:40.960424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:40.960925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:40.967527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:40.969928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:40.974885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:40.978176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:41.359456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:41.367778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-99589e13-991e-4d07-b4fe-8b51107d7dbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1299 microversion: 2.1 time: 0.438891 Aug 22 19:18:41.372448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 23/39] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1299 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:41.389708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:41.406522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:41.421565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:41.422069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:41.422523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:41.423247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:41.423739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:41.424204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:42.103514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:42.126259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a795ae27-ba34-4af1-a9d6-030257421ac9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.752502 Aug 22 19:18:42.126963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 24/40] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:41 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:42.159600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:42.160657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:42.189930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:42.194053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:42.200304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:42.203412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:42.204098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:42.208052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:42.563532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:42.581229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-300e6297-c871-44e5-923c-2f05114b0a4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 2.331197 Aug 22 19:18:42.581836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 17/41] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:42.600162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:42.601123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:42.608906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:42.609725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:42.610379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:42.611289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:42.612010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:42.612665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:42.821128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:43.088438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:43.108387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa635d18-0e55-436e-a469-e4dc63dd300f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1299 microversion: 2.1 time: 0.511880 Aug 22 19:18:43.109340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 18/42] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1299 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:43.264813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:43.276483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d78e4b90-5329-4d62-ae51-0c86234c2ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 1.145629 Aug 22 19:18:43.278736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 25/43] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:42 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:43.283661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:43.287224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:43.310722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:43.313318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:43.314004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:43.315839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:43.318269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:43.318947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:43.588868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e799aa96-bbc2-4cf1-838d-3549c096b1b4 req-dfbc21aa-3ef6-42bf-9e7b-1f7b8f64d64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b", "tag": "bc74abd6-9202-4de7-a53d-ab99cb9d76f0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:43.645586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e799aa96-bbc2-4cf1-838d-3549c096b1b4 req-dfbc21aa-3ef6-42bf-9e7b-1f7b8f64d64c service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:43.647696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e799aa96-bbc2-4cf1-838d-3549c096b1b4 req-dfbc21aa-3ef6-42bf-9e7b-1f7b8f64d64c service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:43.648354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e799aa96-bbc2-4cf1-838d-3549c096b1b4 req-dfbc21aa-3ef6-42bf-9e7b-1f7b8f64d64c service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:43.699564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e799aa96-bbc2-4cf1-838d-3549c096b1b4 req-dfbc21aa-3ef6-42bf-9e7b-1f7b8f64d64c service nova] Creating event network-changed:bc74abd6-9202-4de7-a53d-ab99cb9d76f0 for instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b on hv-cinder-83538 Aug 22 19:18:43.702035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e799aa96-bbc2-4cf1-838d-3549c096b1b4 req-dfbc21aa-3ef6-42bf-9e7b-1f7b8f64d64c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 19:18:43.702589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e799aa96-bbc2-4cf1-838d-3549c096b1b4 req-dfbc21aa-3ef6-42bf-9e7b-1f7b8f64d64c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 19:18:43.705753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98a3b4ef-d5c8-40cb-9875-0c767a5d3835 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:43.707075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98a3b4ef-d5c8-40cb-9875-0c767a5d3835 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:43.708381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98a3b4ef-d5c8-40cb-9875-0c767a5d3835 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:43.714446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98a3b4ef-d5c8-40cb-9875-0c767a5d3835 None None] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:43.714967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98a3b4ef-d5c8-40cb-9875-0c767a5d3835 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:43.715407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98a3b4ef-d5c8-40cb-9875-0c767a5d3835 None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:43.739141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.compute.rpcapi [None req-98a3b4ef-d5c8-40cb-9875-0c767a5d3835 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 19:18:43.740083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98a3b4ef-d5c8-40cb-9875-0c767a5d3835 None None] Releasing lock "compute-rpcapi-router" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 19:18:43.791617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-98a3b4ef-d5c8-40cb-9875-0c767a5d3835 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.678059 Aug 22 19:18:43.792818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 19/44] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:43.798736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:43.799448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:43.812496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:43.816207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:43.822891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:43.824466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:43.826893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:43.828936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:43.829338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:43.857758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:43.878947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-54b85032-9aba-4a45-85ce-f32f58dab87f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.598439 Aug 22 19:18:43.894267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 26/45] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:43 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:44.416801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-e6695e01-0e3f-460a-bb41-5e0454d3e848 req-9132a7cb-2383-4bbc-9ffa-a0d77ebb889a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811f9039-8449-4f72-9793-bf132dd4b093", "tag": "296f73cc-ce7e-4239-b7b5-5c89f1e78d0b"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:44.463295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-e6695e01-0e3f-460a-bb41-5e0454d3e848 req-9132a7cb-2383-4bbc-9ffa-a0d77ebb889a service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:44.463806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-e6695e01-0e3f-460a-bb41-5e0454d3e848 req-9132a7cb-2383-4bbc-9ffa-a0d77ebb889a service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:44.468264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-e6695e01-0e3f-460a-bb41-5e0454d3e848 req-9132a7cb-2383-4bbc-9ffa-a0d77ebb889a service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:44.510673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-e6695e01-0e3f-460a-bb41-5e0454d3e848 req-9132a7cb-2383-4bbc-9ffa-a0d77ebb889a service nova] Creating event network-changed:296f73cc-ce7e-4239-b7b5-5c89f1e78d0b for instance 811f9039-8449-4f72-9793-bf132dd4b093 on hv-cinder-83538 Aug 22 19:18:44.512375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-e6695e01-0e3f-460a-bb41-5e0454d3e848 req-9132a7cb-2383-4bbc-9ffa-a0d77ebb889a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120639) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 19:18:44.515327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-e6695e01-0e3f-460a-bb41-5e0454d3e848 req-9132a7cb-2383-4bbc-9ffa-a0d77ebb889a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120639) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 19:18:44.520048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af7749c5-135a-4bad-91b3-19c5e3fe886a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:44.520849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af7749c5-135a-4bad-91b3-19c5e3fe886a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:44.521478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af7749c5-135a-4bad-91b3-19c5e3fe886a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:44.522438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af7749c5-135a-4bad-91b3-19c5e3fe886a None None] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:44.524210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af7749c5-135a-4bad-91b3-19c5e3fe886a None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:44.525429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af7749c5-135a-4bad-91b3-19c5e3fe886a None None] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:44.544671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.compute.rpcapi [None req-af7749c5-135a-4bad-91b3-19c5e3fe886a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 19:18:44.548743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af7749c5-135a-4bad-91b3-19c5e3fe886a None None] Releasing lock "compute-rpcapi-router" {{(pid=120639) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 19:18:44.579975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-af7749c5-135a-4bad-91b3-19c5e3fe886a None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.689873 Aug 22 19:18:44.580512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 27/46] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:44.591616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:44.592906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:44.605634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:44.606449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:44.607250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:44.608913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:44.609838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:44.610550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:44.771555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:44.780708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-846a77b2-c7eb-40a8-8998-ea99fc8a864e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.986678 Aug 22 19:18:44.785957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 20/47] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:44.806233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:44.810383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:44.828822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:44.829520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:44.830184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:44.831094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:44.831558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:44.832022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:45.049713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:45.064595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fb35a7ea-92db-4000-bfb1-515e716b661e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1299 microversion: 2.1 time: 0.481028 Aug 22 19:18:45.067416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 28/48] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:44 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1299 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:45.086703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:45.090345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:45.113546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:45.116765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:45.118134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:45.122628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:45.123117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:45.124154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:45.774195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:45.919073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:45.929665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5f9fb333-9116-4b64-a92c-d752593ca62b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.860738 Aug 22 19:18:45.931018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 29/49] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:45 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:45.936750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:45.937368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:45.943738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:45.944490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:45.945089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:45.946052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:45.946662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:45.947240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:45.988045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:46.041565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:46.051538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42db2f12-553e-42c7-ac70-375424cdb279 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 1.261788 Aug 22 19:18:46.053544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 21/50] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:44 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:46.095856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:46.099703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:46.123104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:46.128714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:46.129175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:46.130465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:46.131069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:46.132511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:46.177507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:46.192406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-454920da-6d0a-4dfd-b486-a0d524b9892e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.259957 Aug 22 19:18:46.205490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 30/51] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:45 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:46.650779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:46.658456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c2b124b-b50d-483b-8814-ed4fe695f681 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.573045 Aug 22 19:18:46.660350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 22/52] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:46 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:46.683611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-78a15495-bb2c-4e5f-8255-31f21d03ca98 req-65c084eb-9785-414d-8008-1a236dab1991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d520aec1-59d4-4169-9eea-84ec30203610", "tag": "d79a28ec-9fd6-4fed-bcad-77de1d3b3f63"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:46.707334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-78a15495-bb2c-4e5f-8255-31f21d03ca98 req-65c084eb-9785-414d-8008-1a236dab1991 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:46.708165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-78a15495-bb2c-4e5f-8255-31f21d03ca98 req-65c084eb-9785-414d-8008-1a236dab1991 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:46.709636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-78a15495-bb2c-4e5f-8255-31f21d03ca98 req-65c084eb-9785-414d-8008-1a236dab1991 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:46.727872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-78a15495-bb2c-4e5f-8255-31f21d03ca98 req-65c084eb-9785-414d-8008-1a236dab1991 service nova] Creating event network-changed:d79a28ec-9fd6-4fed-bcad-77de1d3b3f63 for instance d520aec1-59d4-4169-9eea-84ec30203610 on hv-cinder-83538 Aug 22 19:18:46.748281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-78a15495-bb2c-4e5f-8255-31f21d03ca98 req-65c084eb-9785-414d-8008-1a236dab1991 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069519 Aug 22 19:18:46.751519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 31/53] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:46.961482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:46.963028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:46.973573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:46.974269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:46.975025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:46.976125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:46.977081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:46.978144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:47.075738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=20 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:47.080661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:47.081392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:47.087849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:47.088577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:47.089716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:47.090660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:47.091338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:47.092071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:47.216372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:47.239295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aae8b152-3d4b-4420-8c5d-2320be06d0b1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.281961 Aug 22 19:18:47.254385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 23/54] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:46 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:47.260097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:47.260718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:47.274091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:47.278299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:47.278787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:47.279525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:47.280020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:47.280446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:47.315313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:47.326782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c44db9a2-ee14-4e54-9ea2-a3028be67b3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.250678 Aug 22 19:18:47.328867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 32/55] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:47 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:47.463976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:47.472884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91f94d98-83ec-4b57-bbb1-0dd41164b5ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.221820 Aug 22 19:18:47.473464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 24/56] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:47.681026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:47.681769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:47.688251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:47.688699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:47.689123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:47.689811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:47.690283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:47.690856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:47.824348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:47.832717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a162903d-d34b-4869-bdc9-5df4404a0afc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.155588 Aug 22 19:18:47.833717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 33/57] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:47 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:48.261636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:48.262383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:48.268375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:48.268846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:48.269298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:48.269975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:48.270438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:48.270854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:48.350645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:48.353118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:48.363803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:48.364453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:48.365071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:48.365754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:48.366357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:48.366848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:48.410668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:48.420602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-127a142e-74db-40e6-8a77-522bf762e142 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.162687 Aug 22 19:18:48.422090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 25/58] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:48 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:48.499968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:48.499968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:48.506339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:48.507079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:48.507715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:48.508646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:48.509844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:48.510306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:48.515384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:48.523160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e2449c48-d11f-412c-a4b8-ed9a7573968d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.177052 Aug 22 19:18:48.536646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 34/59] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:48 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:48.652698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:48.660317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8bec6a0-7e07-4a98-9004-47e1c36be59a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.166183 Aug 22 19:18:48.660889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 26/60] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:48.770383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-89a17c11-47be-43a6-9cab-c820c0fb7e13 req-181f36ec-fe53-4305-aa17-b5f28bb4fc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604c6a93-ddc1-4f33-81a5-f431e35b16a8", "tag": "933102e5-36e2-4542-aa35-4f53ab839827"}, {"name": "network-changed", "server_uuid": "8b95c1a3-7046-4ae9-aec5-fb8838e1d45e", "tag": "9c89ecbc-8920-445b-bd9b-563d448b3243"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:18:48.781442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-89a17c11-47be-43a6-9cab-c820c0fb7e13 req-181f36ec-fe53-4305-aa17-b5f28bb4fc05 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:48.781920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-89a17c11-47be-43a6-9cab-c820c0fb7e13 req-181f36ec-fe53-4305-aa17-b5f28bb4fc05 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:48.782351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-89a17c11-47be-43a6-9cab-c820c0fb7e13 req-181f36ec-fe53-4305-aa17-b5f28bb4fc05 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:48.795193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-89a17c11-47be-43a6-9cab-c820c0fb7e13 req-181f36ec-fe53-4305-aa17-b5f28bb4fc05 service nova] Creating event network-changed:933102e5-36e2-4542-aa35-4f53ab839827 for instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 on hv-cinder-83538 Aug 22 19:18:48.795712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-89a17c11-47be-43a6-9cab-c820c0fb7e13 req-181f36ec-fe53-4305-aa17-b5f28bb4fc05 service nova] Creating event network-changed:9c89ecbc-8920-445b-bd9b-563d448b3243 for instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e on hv-cinder-83538 Aug 22 19:18:48.802650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-89a17c11-47be-43a6-9cab-c820c0fb7e13 req-181f36ec-fe53-4305-aa17-b5f28bb4fc05 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036378 Aug 22 19:18:48.803254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 35/61] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:18:48.853604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:48.854253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:48.860686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:48.861165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:48.861599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:48.862285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:48.862733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:48.863155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:49.007730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:49.011182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:49.016393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db163e04-cd54-48b6-bbe9-a44c8f03baa7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.166906 Aug 22 19:18:49.016958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 27/62] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:48 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:49.442632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:49.443416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:49.449593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:49.450006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:49.450432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:49.451116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:49.451563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:49.452004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:49.546431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:49.547043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:49.553312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:49.553794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:49.554204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:49.554956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:49.555344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:49.555890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:49.606130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:49.613856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a1d02b8b-360d-4a2d-a5f9-adb8ff45e122 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.175287 Aug 22 19:18:49.614956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 36/63] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:49 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:49.682143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:49.682856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:49.692021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:49.692531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:49.692969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:49.693665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:49.694112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:49.694529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:49.720404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:49.728561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6bba121f-34e0-4ea7-893e-0d61dd059a53 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.187687 Aug 22 19:18:49.729137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 28/64] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:49 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:49.830841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:49.838457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-57ca027c-b497-4f4e-a467-a73c30917ce1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.161328 Aug 22 19:18:49.839019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 37/65] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:50.037478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:50.038295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:50.044581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:50.045065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:50.045645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:50.046343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:50.046793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:50.047209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:50.222641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:50.234623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8182bfb-0a13-44ac-a38e-13b87361de5f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.201715 Aug 22 19:18:50.241824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 29/66] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:50 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:50.634230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:50.634873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:50.637917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:50.641412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:50.642329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:50.642329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:50.643043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:50.643495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:50.643934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:50.749574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:50.751219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:50.764146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:50.765330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:50.765783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:50.766509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:50.766972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:50.767403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:50.836194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:50.845785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8cbbe151-6f13-4d80-a8ac-260eafbaa132 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.215248 Aug 22 19:18:50.847045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 38/67] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:50 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:50.866408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:50.867284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:50.873194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:50.873848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:50.874281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:50.874968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:50.875414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:50.875863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:50.937740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:50.945407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-287a2a6d-954c-4346-9968-e0afe271e048 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.200202 Aug 22 19:18:50.945988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 30/68] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:50 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:51.015448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:51.023554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b93e2cf8-7fea-4f24-b9e3-a58e23174995 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.160889 Aug 22 19:18:51.024162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 39/69] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:50 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:51.255604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:51.256244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:51.262907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:51.263389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:51.263846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:51.264538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:51.264986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:51.265434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:51.397159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:51.405660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b27ab89-9741-4caf-8f3f-8cdacc5cadb4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.153876 Aug 22 19:18:51.406226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 31/70] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:51 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:51.870105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:51.871478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:51.883515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:51.884188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:51.884626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:51.885340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:51.888232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:51.889638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:51.968370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:51.968984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:51.975983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:51.977469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:51.978124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:51.983764 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:51.984441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:51.984931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:52.117714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:52.128072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c96dc8fd-5eb6-456d-81d4-9571c5c24687 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.262159 Aug 22 19:18:52.132342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 40/71] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:51 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:52.141266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:52.141885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:52.148647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:52.149178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:52.150255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:52.151157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:52.151818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:52.152299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:52.247024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:52.255279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c367dfb6-69b6-43ce-922c-262602e4f764 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.290726 Aug 22 19:18:52.256203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 32/72] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:51 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:52.351164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:52.362222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d0bca4d6-74e2-49de-8d75-6ed1b00a2d88 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.225094 Aug 22 19:18:52.362817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 41/73] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:52.427575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:52.428703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:52.436497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:52.437513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:52.438056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:52.438838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:52.439399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:52.439931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:52.610549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:52.618806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac0437ee-6d1b-4c44-a8ff-ee748ed74c06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.196146 Aug 22 19:18:52.619380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 33/74] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:52 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:53.153824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:53.155464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:53.162254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:53.163027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:53.163534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:53.164385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:53.164872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:53.165374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:53.276334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:53.276930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:53.284494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:53.284986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:53.285560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:53.286344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:53.286993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:53.287517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:53.380095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:53.391078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8d1d1ba6-bb7e-44bf-9078-f90b47d7782b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.240903 Aug 22 19:18:53.392488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 42/75] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:53 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:53.397943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:53.399113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:53.405371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:53.405931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:53.406573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:53.407509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:53.408134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:53.408854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:53.488032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:53.500520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7c85819-fe3f-498e-a200-034b6aa4a1d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.228152 Aug 22 19:18:53.501463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 34/76] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:53 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:53.577349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:53.584976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-caf61c84-72fc-44cd-9cd4-75560c7a9afc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.190902 Aug 22 19:18:53.587710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 43/77] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:53.640736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:53.641661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:53.649950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:53.650558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:53.651118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:53.652886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:53.653692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:53.654050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:53.737739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:53.795272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:53.803821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5ea99b6-638b-4a65-805f-b54f0c4bd550 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.168253 Aug 22 19:18:53.804398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 35/78] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:53 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:54.412944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:54.414268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:54.420503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:54.420984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:54.421411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:54.422105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:54.422552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:54.422953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:54.524207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:54.524823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:54.531934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:54.532489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:54.532933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:54.533776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:54.534253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:54.534874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:54.543336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:54.569855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:54.578351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4e4256fd-7868-49eb-bbd4-51bf7846ad6e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.169069 Aug 22 19:18:54.579072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 44/79] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:54 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:54.606501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:54.607119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:54.613349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:54.613838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:54.614277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:54.615175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:54.615629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:54.616081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:54.694773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:54.719393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-afbf101d-1058-4ecb-b850-8e5ecb7b673f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.198850 Aug 22 19:18:54.720038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 36/80] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:54 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:54.756222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:54.763804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-80435e3c-4ef7-40c5-b133-a82fa9117ed1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.162133 Aug 22 19:18:54.764365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 45/81] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:54.826036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:54.826649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:54.832424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:54.832904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:54.833330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:54.834014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:54.834467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:54.834884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:54.965084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:54.973526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa65d120-fadf-4b8d-8be6-991d63f12149 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.151253 Aug 22 19:18:54.974107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 37/82] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:54 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:55.599913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:55.600521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:55.607135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:55.607634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:55.608098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:55.608889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:55.609350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:55.610141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:55.740265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:55.740905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:55.747700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:55.752275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:55.757017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:55.757857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:55.758420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:55.758862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:55.802759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:55.811876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-611cb03d-1ae0-4874-9e2b-2d620a68c5db tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.215623 Aug 22 19:18:55.812691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 46/83] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:55 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:55.817530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:55.818147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:55.825231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:55.825716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:55.826401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:55.827083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:55.827669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:55.828165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:56.017261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:56.025267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40d20ae4-a8cb-453d-823e-5b2d81598f73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.288943 Aug 22 19:18:56.025846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 38/84] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:55 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:56.027367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:56.030789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:56.031401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:56.035370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1264302e-146d-44c5-8298-4e508bb71230 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.221503 Aug 22 19:18:56.035984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 47/85] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:55 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:56.037016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:56.037502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:56.037934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:56.038621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:56.039071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:56.039490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:56.537753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:56.546163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a153e8a-9a9e-4308-8f45-9c262df5751b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.519331 Aug 22 19:18:56.547053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 39/86] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:56 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:56.832265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:56.832897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:56.838782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:56.839792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:56.840223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:56.840905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:56.841348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:56.841763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:56.845623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:56.974654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:56.983741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-12c0cbff-1625-412f-be97-9be7df2bbad5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.155197 Aug 22 19:18:56.984312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 48/87] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:56 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:57.046558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:57.047174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:57.056308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:57.056919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:57.062624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:57.062826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:57.063312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:57.063416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:57.063776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:57.063897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:57.064475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:57.064865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:57.064968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:57.065333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:57.065441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:57.065873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:57.205434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:57.205882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:57.213250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f8228d23-729c-4bac-a1d2-aadd42ff350f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.160628 Aug 22 19:18:57.213399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7bbbc1e9-4534-46e8-98df-2b0c8b2a624f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.171111 Aug 22 19:18:57.213931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 40/88] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:57 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:57.214682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 49/89] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:57 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:57.566008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:57.566611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:57.572579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:57.573061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:57.574216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:57.574916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:57.575312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:57.575752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:57.703965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:57.711443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97037291-570a-4bea-b708-54200b0881a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.149142 Aug 22 19:18:57.712034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 41/90] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:57 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:58.003971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:58.004489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:58.010377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:58.010858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:58.011286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:58.011988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:58.012437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:58.012853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:58.137483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:58.145680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dcc425cb-9e19-4197-8e8c-c6999ec58006 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.145677 Aug 22 19:18:58.146355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 50/91] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:57 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:58.234761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:58.235378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:58.235505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:58.236055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:58.241291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:58.241766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:58.241881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:58.242193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:58.242320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:58.242758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:58.242869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:58.243300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:58.243439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:58.243751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:58.243917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:58.244340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:58.373303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:58.374012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:58.380952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-24cf03e7-1b1f-4256-a7fe-46be8ddfbb86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.149384 Aug 22 19:18:58.381514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 51/92] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:58 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:58.381612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac13ab01-981e-48fb-bd72-b4e9dff72fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.150521 Aug 22 19:18:58.382172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 42/93] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:58 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:58.731807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:58.732414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:58.738463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:58.738942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:58.739382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:58.740118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:58.740571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:58.740991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:58.867190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:58.875291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e49195b9-29f7-4ebd-9897-5f11ba4fcc4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.147807 Aug 22 19:18:58.875889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 52/94] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:58 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:59.166321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:59.166932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:59.173138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:59.173621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:59.174052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:59.174904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:59.175210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:59.175714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:59.302207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:59.310154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17110859-e0d0-4115-8183-f15d57524519 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.147731 Aug 22 19:18:59.310716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 43/95] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:59 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:59.401479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:59.401984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:59.402118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:59.402427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:59.408043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:59.408528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:59.408647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:59.408962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:59.409062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:59.409437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:59.409649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:59.410122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:59.410226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:59.410544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:59.410652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:59.411067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:59.429404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:18:59.537034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:59.541642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:18:59.545062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5a0af50a-9478-4a32-9451-ec54c269358c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.147425 Aug 22 19:18:59.545635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 53/96] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:59 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:18:59.550119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18348454-4694-4332-8fcd-5d6f0ea8abc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.152112 Aug 22 19:18:59.550705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 44/97] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:59 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:18:59.896048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:18:59.896687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:18:59.903130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:59.903550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:59.904002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:18:59.904669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:18:59.905113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:18:59.905527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:00.032431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:00.039890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-467553eb-1366-45c3-adef-a029c368d213 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.147655 Aug 22 19:19:00.040449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 54/98] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:18:59 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:00.330110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:00.330724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:00.336558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:00.337042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:00.337477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:00.338163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:00.338618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:00.339704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:00.464846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:00.472281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f57e798b-3fde-47d2-833c-a0b2fedd42e1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.145925 Aug 22 19:19:00.472851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 45/99] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:00 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:00.566090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:00.566701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:00.569887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:00.570497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:00.574162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:00.574642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:00.575072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:00.575789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:00.576239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:00.576656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:00.576980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:00.577448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:00.577884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:00.578579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:00.579035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:00.579461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:00.711894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:00.720251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1a6f1f20-21e4-4095-ad80-8e5ddb45f2a4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.157892 Aug 22 19:19:00.720551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:00.720829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 55/100] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:00 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:00.728391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff0d068f-a17c-4065-98f0-942211f842bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.162269 Aug 22 19:19:00.728939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 46/101] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:00 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:01.060909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:01.061517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:01.067393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:01.067903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:01.068336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:01.069017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:01.069464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:01.069885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:01.199065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:01.206663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-635ed2e9-576a-4866-906a-65be8ff50a3f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.149524 Aug 22 19:19:01.207225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 56/102] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:01 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:01.493441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:01.494126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:01.500854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:01.501420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:01.501943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:01.503090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:01.503634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:01.504140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:01.638640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:01.643132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33fcd3fd-8441-4b73-b90d-c87da5235c03 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.153562 Aug 22 19:19:01.643726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 47/103] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:01 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:01.742045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:01.745223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:01.749685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:01.750444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:01.752487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:01.752895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:01.753331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:01.754208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:01.754665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:01.755083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:01.757249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:01.757729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:01.758313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:01.759186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:01.759633 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:01.760083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:01.906957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:01.913334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:01.914992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-390e941c-0e8f-4fe1-88e1-8006f22382c5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.169652 Aug 22 19:19:01.915678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 48/104] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:01 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:01.921820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6f97c3b8-b186-444d-9158-97fea99da619 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.184150 Aug 22 19:19:01.922642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 57/105] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:01 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:02.228138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:02.228752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:02.235271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:02.235834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:02.236273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:02.236957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:02.237408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:02.237826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:02.367974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:02.375514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8a36764-cb29-4334-b215-75872f207e3e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.151479 Aug 22 19:19:02.376109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 49/106] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:02 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:02.663669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:02.664295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:02.670620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:02.671153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:02.671624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:02.672468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:02.672834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:02.673354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:02.805593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:02.814462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b0e76e70-788b-41d2-9d1b-e49839588517 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.154736 Aug 22 19:19:02.815054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 58/107] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:02 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:02.937120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:02.942218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:02.942818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:02.945180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:02.956781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:02.957484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:02.958098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:02.958481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:02.959753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:02.960471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:02.961042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:02.961651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:02.962069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:02.962847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:02.963303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:02.963748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:03.130189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:03.140982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c0bcfd92-a881-4282-b297-430d44a6f186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.202533 Aug 22 19:19:03.156795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:03.158258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 59/108] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:02 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:03.165781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51f81adf-de82-42f8-b82b-074d331985c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.233520 Aug 22 19:19:03.166487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 50/109] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:02 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:03.397272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:03.398308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:03.405477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:03.406298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:03.406760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:03.407632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:03.408186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:03.408693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:03.550464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:03.558768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-59342a05-7fc2-4eab-88c7-6949996c6a34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.165879 Aug 22 19:19:03.559392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 60/110] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:03 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:03.835511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:03.836168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:03.842964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:03.843478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:03.843999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:03.844717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:03.845173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:03.845597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:03.978887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:03.986385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d48d453d-ac62-42ab-a410-a686a56ad333 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.154880 Aug 22 19:19:03.986940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 51/111] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:03 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:04.161840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:04.162449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:04.168454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:04.168934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:04.169365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:04.170048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:04.170494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:04.170915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:04.188977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:04.189579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:04.195532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:04.196191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:04.196631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:04.197328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:04.197782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:04.198697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:04.302799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:04.311132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-70c56fa1-4d67-4693-be60-443724915cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.153049 Aug 22 19:19:04.311727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 61/112] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:04 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:04.330665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:04.338389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06d822b4-459e-479c-8a83-2ec88d13e0dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.153169 Aug 22 19:19:04.339051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 52/113] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:04 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:04.579922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:04.580528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:04.586431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:04.586907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:04.587335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:04.588040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:04.588537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:04.588932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:04.715466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:04.724847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d46fdb2a-fc63-4370-98bf-195b1da109e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.148624 Aug 22 19:19:04.739135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 62/114] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:04 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:05.006104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:05.006710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:05.012614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:05.013092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:05.013521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:05.014199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:05.014648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:05.015063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:05.144058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:05.152197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7ac5092-8d3b-46ef-9352-d48bd1ab7506 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.149307 Aug 22 19:19:05.152758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 53/115] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:05 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:05.331838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:05.332458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:05.338303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:05.338773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:05.339218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:05.339941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:05.340387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:05.340799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:05.359396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:05.360190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:05.366472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:05.367160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:05.367594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:05.368345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:05.368795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:05.369212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:05.468139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:05.475854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8d944e7b-0b6b-4a92-88f1-d2cf332cd2b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.147854 Aug 22 19:19:05.476417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 63/116] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:05 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:05.498093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:05.505744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8f1a82d-4e0d-4985-8077-1c19db5eb3d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.150982 Aug 22 19:19:05.506321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 54/117] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:05 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:05.746996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:05.747828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:05.753826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:05.754314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:05.754920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:05.755617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:05.756238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:05.756838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:05.896766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:05.900792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:05.905988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6af02b86-bb34-4546-b84e-2232df28e77f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.163367 Aug 22 19:19:05.906567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 64/118] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:05 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:06.173112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:06.173749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:06.179836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:06.180316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:06.180746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:06.181428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:06.181876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:06.182295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:06.308602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:06.316170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac488db7-ba27-472b-99c2-a61e2178d8b7 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.146892 Aug 22 19:19:06.316747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 55/119] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:06 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:06.497116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:06.497715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:06.503809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:06.504281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:06.504709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:06.505384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:06.505829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:06.506240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:06.526230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:06.527346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:06.533279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:06.533757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:06.534196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:06.534894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:06.535348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:06.535815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:06.636167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:06.644837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-11f8dba0-f3bb-412f-aa85-131fc6d7e73e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.151591 Aug 22 19:19:06.645587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 65/120] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:06 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:06.670704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:06.678213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a3208ce-b830-41e2-9378-ee71aa5db9d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.155874 Aug 22 19:19:06.678770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 56/121] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:06 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:06.926464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:06.927077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:06.933366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:06.933849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:06.934285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:06.934972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:06.935425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:06.935881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:07.065074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:07.072661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-faa3c0d1-bdf0-435c-ae37-e82dd9f161f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.150349 Aug 22 19:19:07.073778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 66/122] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:06 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:07.336257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:07.336774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:07.343137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:07.343615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:07.344079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:07.344757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:07.345207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:07.345625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:07.470442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:07.478268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3af1d949-3e56-413c-96cf-64689e7edca9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.145968 Aug 22 19:19:07.478835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 57/123] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:07 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:07.665944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:07.666581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:07.672921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:07.673391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:07.673819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:07.674492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:07.675021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:07.675434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:07.698657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:07.699301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:07.710193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:07.710680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:07.711108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:07.711826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:07.712273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:07.712693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:07.805298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:07.813156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3f4e8042-da06-4708-b9b2-6b3f7ed751a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.150923 Aug 22 19:19:07.813735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 67/124] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:07 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:08.002571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:08.010316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-862de9bf-2793-4845-ac80-985e6dd1fc03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.315839 Aug 22 19:19:08.011585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 58/125] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:07 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:08.093381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:08.093996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:08.099923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:08.100401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:08.100833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:08.101515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:08.102231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:08.102652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:08.233918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:08.241520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-838e64b7-5b43-4e1e-bd67-e86cbb9fa874 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.151864 Aug 22 19:19:08.242082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 68/126] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:08 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:08.499936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:08.500478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:08.506384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:08.506860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:08.507294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:08.508042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:08.508639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:08.509289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:08.638853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:08.647673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-779aeecb-a789-4d6b-90ae-0f2b00827511 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.152250 Aug 22 19:19:08.648267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 59/127] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:08 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:08.834470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:08.835112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:08.841740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:08.842212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:08.842703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:08.843403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:08.843866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:08.844279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:08.977293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:08.986017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-53ed9fbc-d987-4a03-9ac7-21f6f1caa637 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.155425 Aug 22 19:19:08.986728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 69/128] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:08 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:09.032464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:09.033069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:09.039013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:09.039543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:09.040730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:09.041699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:09.042930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:09.043350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:09.208264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:09.217600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6778bd4-4308-4f9a-bfbc-514db22c9a90 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.189317 Aug 22 19:19:09.218199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 60/129] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:09 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:09.263106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:09.263637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:09.269623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:09.270101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:09.270740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:09.271416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:09.272019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:09.273889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:09.406623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:09.414296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7016152b-bfbe-4a17-bf02-eab189b2a7b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.155815 Aug 22 19:19:09.414955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 70/130] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:09 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:09.670296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:09.670995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:09.678024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:09.678578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:09.679120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:09.679912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:09.680449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:09.680944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:09.685678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:09.826470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:09.834337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1acb8151-470c-43a5-b7ff-c7477e8f9a76 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.167920 Aug 22 19:19:09.847960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 61/131] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:09 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:10.008980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:10.010317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:10.017635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:10.018434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:10.019396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:10.020631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:10.021280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:10.021825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:10.192073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:10.203590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0d3c676b-fbcc-43a6-8ae7-9d393ce8e1af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.200085 Aug 22 19:19:10.217602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 71/132] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:10 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:10.244028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:10.244684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:10.252790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:10.253868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:10.254499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:10.255667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:10.256901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:10.257565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:10.435774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:10.436685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:10.446594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:10.447314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:10.447972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:10.450097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:10.452536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:10.453207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:10.545456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:10.554042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f083503-59c3-4536-8f8a-189436138854 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.314619 Aug 22 19:19:10.554944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 62/133] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:10.746787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-80fa6546-a5b6-4df4-956c-d25bfb95f41e req-35d63cb6-2b96-4108-9e85-5f1912ad4805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b95c1a3-7046-4ae9-aec5-fb8838e1d45e", "name": "network-vif-plugged", "status": "completed", "tag": "9c89ecbc-8920-445b-bd9b-563d448b3243"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:19:10.759358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80fa6546-a5b6-4df4-956c-d25bfb95f41e req-35d63cb6-2b96-4108-9e85-5f1912ad4805 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:10.760157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80fa6546-a5b6-4df4-956c-d25bfb95f41e req-35d63cb6-2b96-4108-9e85-5f1912ad4805 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:10.761373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80fa6546-a5b6-4df4-956c-d25bfb95f41e req-35d63cb6-2b96-4108-9e85-5f1912ad4805 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:10.773627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-80fa6546-a5b6-4df4-956c-d25bfb95f41e req-35d63cb6-2b96-4108-9e85-5f1912ad4805 service nova] Creating event network-vif-plugged:9c89ecbc-8920-445b-bd9b-563d448b3243 for instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e on hv-cinder-83538 Aug 22 19:19:10.779678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-80fa6546-a5b6-4df4-956c-d25bfb95f41e req-35d63cb6-2b96-4108-9e85-5f1912ad4805 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104843 Aug 22 19:19:10.780756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 63/134] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:19:10.791407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:10.800099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4728ac77-3977-41f4-a2ea-eee63449b4b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.368920 Aug 22 19:19:10.801359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 72/135] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:10 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:10.858024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:10.858697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:10.866456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:10.866944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:10.867822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:10.868750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:10.876215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:10.876780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:11.038898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:11.050407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97b48041-493e-45d4-894c-e76af1b2bb61 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.196724 Aug 22 19:19:11.050918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 64/136] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:10 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:11.226205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:11.227592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:11.235304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:11.235950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:11.236496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:11.237521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:11.238241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:11.238892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:11.383361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:11.391237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b3b934c6-fc20-47bd-abaa-5918f47cf1fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.170580 Aug 22 19:19:11.404200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 73/137] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:11 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:11.577018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:11.578052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:11.587759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:11.588536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:11.589564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:11.591312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:11.592020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:11.592670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:11.808681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:11.819475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ea9074f-0a62-4b16-a169-a38fe0a17385 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.246490 Aug 22 19:19:11.820090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 65/138] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:11 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:11.829723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:11.830818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:11.847157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:11.847850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:11.848388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:11.849084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:11.849535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:11.849954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:12.073035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:12.080233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:12.080950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:12.089457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9b4c8ddf-377b-46df-bd38-4ea95a8c244f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.271114 Aug 22 19:19:12.093554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:12.095255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:12.095602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:12.096324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:12.096773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:12.097192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:12.097670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 74/139] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:11 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:12.256181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:12.265527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d6dcadb0-5962-4e7c-889e-5ac469f472b6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.197628 Aug 22 19:19:12.266583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 66/140] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:12 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:12.413562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:12.414520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:12.421987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:12.422589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:12.423115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:12.424104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:12.424670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:12.425244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:12.563741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:12.571932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f31f0a35-c4cd-46ee-9c16-e6df7fe1d628 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.163029 Aug 22 19:19:12.573972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 75/141] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:12 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:12.840908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:12.842085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:12.850586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:12.851078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:12.851556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:12.857430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:12.857786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:12.858218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:13.032769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:13.041193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df318e51-5409-4846-a08a-575db9994d50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.204247 Aug 22 19:19:13.054160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 67/142] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:12 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:13.129405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:13.130796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:13.138574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:13.140669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:13.141312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:13.142498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:13.143093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:13.143693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:13.286883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:13.288071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:13.297645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:13.298524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:13.299260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:13.300205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:13.300797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:13.301393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:13.301506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:13.311712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c3e801ee-f810-4868-917e-24e54124f9b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.193898 Aug 22 19:19:13.313557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 76/143] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:13.457713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:13.465987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-837723cf-6346-430b-bd5c-9f9726d9535c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.183498 Aug 22 19:19:13.466555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 68/144] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:13 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:13.593294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:13.594483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:13.602222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:13.602831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:13.603325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:13.605001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:13.606114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:13.606737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:13.767884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:13.779045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ed523e3d-96fa-4fa8-8001-affa32279884 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.189447 Aug 22 19:19:13.780432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 77/145] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:13 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:14.062305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:14.062922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:14.064980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=97 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:14.069886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:14.070369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:14.070802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:14.071684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:14.072144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:14.072566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:14.225252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:14.234146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3ae2032d-b203-41c9-b0e8-af4765ac1241 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.175556 Aug 22 19:19:14.234716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 69/146] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:14.333222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:14.333825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:14.340384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:14.340864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:14.341290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:14.341997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:14.342420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:14.342833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:14.468019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:14.475766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d6911a48-48d6-4909-afaa-23e7aa27102a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.146777 Aug 22 19:19:14.476337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 78/147] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:14.486639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:14.487245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:14.493093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:14.493563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:14.493992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:14.494670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:14.495182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:14.495597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:14.623276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:14.631231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2dbc4b66-3a91-4648-ad31-21ba6796e0e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.148323 Aug 22 19:19:14.631837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 70/148] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:14 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:14.804843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:14.805460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:14.811901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:14.812376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:14.812810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:14.813492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:14.813993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:14.814343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:14.938828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:14.946295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-84ff5e7b-42ec-4096-a80c-2e1ededf0159 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.145243 Aug 22 19:19:14.946875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 79/149] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:14 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:15.253782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:15.254392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:15.260341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:15.260820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:15.261260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:15.261941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:15.262388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:15.262855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:15.392453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:15.399956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff45d3df-9d5e-4a41-b8f0-f98621556bd5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.149939 Aug 22 19:19:15.400459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 71/150] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:15.496855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:15.497459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:15.503351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:15.503859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:15.504290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:15.504960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:15.505417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:15.505815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:15.628739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:15.636232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-86353e0a-48f6-4a6c-89e9-397868511e0b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.143164 Aug 22 19:19:15.636789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 80/151] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:15.652010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:15.652554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:15.658403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:15.658898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:15.659306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:15.660016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:15.660465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:15.660914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:15.784957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:15.793037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b07114af-c0d3-4c5f-9b72-345b0ab879ed tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.145449 Aug 22 19:19:15.793596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 72/152] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:15 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:15.967113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:15.967742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:15.973538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:15.974013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:15.974436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:15.975139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:15.975553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:15.975995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:15.995308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:16.104482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:16.111985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-58ddd487-3576-4723-bfed-01312bda7efe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.149665 Aug 22 19:19:16.112549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 81/153] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:15 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:16.420610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:16.421212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:16.427179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:16.427679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:16.428118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:16.428796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:16.429243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:16.429665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:16.553748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:16.561341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a1bf622-c4de-4b44-8fc3-19d9bf3312b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.145191 Aug 22 19:19:16.561908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 73/154] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:16 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:16.657084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:16.657685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:16.663765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:16.664233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:16.664654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:16.665326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:16.665761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:16.666176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:16.788129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:16.795562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ebfdbbf6-1f05-444f-9ae5-6c3208fddbe3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.142248 Aug 22 19:19:16.796149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 82/155] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:16.813639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:16.814299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:16.820118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:16.820597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:16.821029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:16.821714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:16.822163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:16.822585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:16.953079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:16.960666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff081d2e-fbde-4904-9840-1edc16316f98 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.150883 Aug 22 19:19:16.961223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 74/156] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:16 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:17.132088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:17.132677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:17.139394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:17.139902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:17.140336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:17.141033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:17.141482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:17.141895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:17.271781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:17.279352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8d46c27b-4119-4c99-9994-02a0a6bb33af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.150951 Aug 22 19:19:17.291668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 83/157] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:17 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:17.583243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:17.583853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:17.590112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:17.590608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:17.591035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:17.591749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:17.592201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:17.592624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:17.725376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:17.733831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41251b13-4c19-4358-af31-77dbd348fb46 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.154776 Aug 22 19:19:17.734390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 75/158] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:17 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:17.817004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:17.817608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:17.823481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:17.823992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:17.824416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:17.825099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:17.825544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:17.825957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:17.951343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:17.958924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-131e91e8-c40f-4a6c-abaf-2d5e432f94e5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.145679 Aug 22 19:19:17.959488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 84/159] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:17.982590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:17.983233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:17.989037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:17.989521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:17.989950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:17.990637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:17.991085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:17.991506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:18.119150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:18.126692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95e74cd2-cf87-4707-8e89-dcfaa9c364e3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.148644 Aug 22 19:19:18.127255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 76/160] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:17 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:18.300127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:18.300729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:18.306532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:18.307000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:18.307426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:18.308122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:18.308566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:18.308979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:18.438378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:18.446747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-95c5bc36-6cd6-4941-8d35-5d7565163e1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.150346 Aug 22 19:19:18.447315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 85/161] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:18 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:18.703321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-73eb331e-1e60-4478-8bf2-f83df0e410b1 req-f1d2d8b2-fe4f-422e-9ccd-d558a0b24b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b", "name": "network-vif-plugged", "status": "completed", "tag": "bc74abd6-9202-4de7-a53d-ab99cb9d76f0"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:19:18.712932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-73eb331e-1e60-4478-8bf2-f83df0e410b1 req-f1d2d8b2-fe4f-422e-9ccd-d558a0b24b2b service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:18.713459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-73eb331e-1e60-4478-8bf2-f83df0e410b1 req-f1d2d8b2-fe4f-422e-9ccd-d558a0b24b2b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:18.714080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-73eb331e-1e60-4478-8bf2-f83df0e410b1 req-f1d2d8b2-fe4f-422e-9ccd-d558a0b24b2b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:18.725291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-73eb331e-1e60-4478-8bf2-f83df0e410b1 req-f1d2d8b2-fe4f-422e-9ccd-d558a0b24b2b service nova] Creating event network-vif-plugged:bc74abd6-9202-4de7-a53d-ab99cb9d76f0 for instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b on hv-cinder-83538 Aug 22 19:19:18.731004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-73eb331e-1e60-4478-8bf2-f83df0e410b1 req-f1d2d8b2-fe4f-422e-9ccd-d558a0b24b2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031264 Aug 22 19:19:18.731780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 77/162] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:19:18.754192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:18.754810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:18.761204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:18.761680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:18.762114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:18.762798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:18.763246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:18.763679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:18.890365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:18.897834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c686d987-f4b8-4075-ab7b-2bd41cbf2997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.147485 Aug 22 19:19:18.898394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 86/163] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:18 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:18.981336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:18.981956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:18.988094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:18.988726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:18.989155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:18.989840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:18.990282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:18.990694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:19.125615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:19.134281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7207e2d8-c7e4-4a73-b7e4-665593ed6a4c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.157681 Aug 22 19:19:19.135913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 78/164] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:19.151555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:19.152430 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:19.158658 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:19.159130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:19.159555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:19.160334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:19.160776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:19.161388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:19.306308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:19.316846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-48526411-5571-47cc-aac8-6eb908cd79e2 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.169950 Aug 22 19:19:19.317583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 87/165] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:19 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:19.469079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:19.469957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:19.476476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:19.477438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:19.478173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:19.479324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:19.480491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:19.480922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:19.488692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:19.616170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:19.623973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39e45bb2-0c69-4448-93b7-ee8e291d43b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.158897 Aug 22 19:19:19.624519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 79/166] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:19 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:19.917566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:19.918202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:19.921243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:19.924767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:19.925249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:19.925678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:19.926358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:19.926813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:19.927227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:20.156063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:20.156677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:20.162809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:20.163291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:20.163749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:20.164452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:20.164902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:20.165322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:20.225053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:20.232820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cfae6568-fa4b-41dc-8afa-82c0e0dca931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.319151 Aug 22 19:19:20.233372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 88/167] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:20.293124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:20.300712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-116ffc85-a44e-4255-b6fe-3c0016acad41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.148470 Aug 22 19:19:20.301271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 80/168] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:20 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:20.338083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:20.338690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:20.344454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:20.344920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:20.345340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:20.346013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:20.346456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:20.346870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:20.470758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:20.478466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-711d1316-8337-46a8-b35b-745581c22625 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.144171 Aug 22 19:19:20.479023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 89/169] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:20 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:20.644353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:20.644990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:20.650960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:20.651446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:20.651895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:20.652590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:20.653028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:20.653483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:20.784992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:20.793679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-821cb758-34ad-4ee8-bf53-ad6e69617e09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.152956 Aug 22 19:19:20.794448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 81/170] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:20 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:21.253663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:21.254197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:21.260104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:21.261093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:21.261519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:21.262194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:21.262635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:21.263048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:21.321894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:21.322503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:21.328926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:21.329404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:21.329838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:21.330520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:21.330967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:21.331386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:21.386504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:21.394189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7c242ff0-2684-4601-a69c-ff5f4fdc8e36 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.144403 Aug 22 19:19:21.394749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 90/171] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:21 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:21.457910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:21.466147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73de0fd5-a598-40f8-85c7-d0146ba43cb0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.148196 Aug 22 19:19:21.466703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 82/172] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:21.499963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:21.500598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:21.506634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:21.507108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:21.507534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:21.508236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:21.508684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:21.509100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:21.637612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:21.645096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-af79880e-72d6-4161-aa35-38843434dccd tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.148862 Aug 22 19:19:21.645656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 91/173] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:21 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:21.813340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:21.813938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:21.819812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:21.820285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:21.820710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:21.821382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:21.821822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:21.822235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:21.950113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:21.957681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-716200e2-17f5-4648-8352-97fdc2d021f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.148035 Aug 22 19:19:21.958243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 83/174] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:21 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:22.415248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:22.415815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:22.422421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:22.422901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:22.423327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:22.424067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:22.424513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:22.424961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:22.487028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:22.487742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:22.493949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:22.494421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:22.494911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:22.495594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:22.496069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:22.496483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:22.551093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:22.558877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dc6f3bbe-0f69-400b-aa1c-6f7d7226a60c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.147460 Aug 22 19:19:22.559443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 92/175] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:22 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:22.630202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:22.638325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33ecc618-319c-49ad-bc0b-c9b2af76181d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.155451 Aug 22 19:19:22.638875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 84/176] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:22.665591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:22.666783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:22.672568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:22.673039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:22.673465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:22.674136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:22.674579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:22.674992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:22.801366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:22.809006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5dd7a2b0-680f-4c7d-8eb7-2ceebb576241 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.147497 Aug 22 19:19:22.809561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 93/177] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:22 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:22.978541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:22.979141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:22.984907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:22.985380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:22.985808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:22.986486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:22.986932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:22.987345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:23.115374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:23.123566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6aa3cd17-b0fb-4d2a-8d35-e13fdcf28f2d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.149070 Aug 22 19:19:23.124153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 85/178] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:22 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:23.578308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:23.578813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:23.584687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:23.585158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:23.585582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:23.586253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:23.586695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:23.587103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:23.670153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:23.670834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:23.676842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:23.677318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:23.677747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:23.678424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:23.678866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:23.679278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:23.716724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:23.725033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f34356b6-1599-43f1-97ed-4835067a7e51 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.150532 Aug 22 19:19:23.725696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 94/179] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:23 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:23.814908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:23.822405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f572402d-4aea-4704-88b8-1eb04b122b26 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.156643 Aug 22 19:19:23.824221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 86/180] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:23.830165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:23.830706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:23.836644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:23.837111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:23.837536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:23.838208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:23.839190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:23.839604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:23.964998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:23.972497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d5cea121-bf4f-4126-ae83-b68d789ad5c5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.146173 Aug 22 19:19:23.973053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 95/181] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:23 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:24.144642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:24.145165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:24.151055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:24.151719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:24.152175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:24.152926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:24.153376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:24.153797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:24.331709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:24.339267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8e9ec2e-c0fd-4da7-bd52-d0961ee8a313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.198537 Aug 22 19:19:24.340128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 87/182] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:24 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:24.746600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:24.747334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:24.753488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:24.754119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:24.754529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:24.755223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:24.755757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:24.756108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:24.842087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:24.842693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:24.849575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:24.850059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:24.850489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:24.851182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:24.851627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:24.852329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:24.887688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:24.895486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4d6a8307-bfa5-43ed-bfb3-c1a64c547392 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.153242 Aug 22 19:19:24.896088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 96/183] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:24.981930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:24.992796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad7073e0-2611-48c0-a81b-3542e362fd9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.154450 Aug 22 19:19:25.003682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 88/184] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:25.003833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:25.003833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:25.003833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:25.003833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:25.004141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:25.004141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:25.004264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:25.004744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:25.136221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:25.143856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8af0bca5-a21f-4578-83c4-f852dc21debc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.153460 Aug 22 19:19:25.144422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 97/185] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:24 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:25.360530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:25.361150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:25.367034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:25.367504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:25.368031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:25.368702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:25.369144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:25.369557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:25.496645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:25.504094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1754eab4-ec74-43c3-941e-7c24f4298e70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.147585 Aug 22 19:19:25.504652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 89/186] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:25 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:25.915952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:25.916559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:25.922858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:25.923332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:25.923799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:25.924480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:25.924925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:25.925342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:25.929236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:26.016486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:26.017123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:26.023269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:26.023781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:26.024209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:26.024892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:26.025336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:26.025904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:26.050613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:26.058309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ccbf632d-a087-4b37-a0b2-b99d1d4add80 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.146093 Aug 22 19:19:26.058876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 98/187] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:25 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:26.149737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:26.157778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d497e36a-7153-4322-a1d7-1340f6171aa6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.145088 Aug 22 19:19:26.158372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 90/188] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:26 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:26.164372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:26.164982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:26.171435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:26.171968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:26.172401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:26.173080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:26.173525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:26.173942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:26.299809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:26.307284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8c2963db-3940-4d49-9251-7e4b3b036068 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.146716 Aug 22 19:19:26.307879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 99/189] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:26 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:26.525198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:26.525747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:26.533949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:26.534419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:26.534842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:26.535538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:26.535988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:26.536401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:26.661636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:26.669082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fc86ceb-3fdc-4f8f-af13-0a073253fa36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.147801 Aug 22 19:19:26.669641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 91/190] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:26 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:27.078838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:27.079385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:27.085320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:27.085793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:27.086218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:27.086896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:27.087342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:27.087804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:27.179498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:27.180276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:27.186698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:27.187188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:27.188117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:27.188811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:27.189253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:27.189672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:27.213700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:27.221332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cb76f64c-514d-4bb7-a19f-6e2b4670d609 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.146312 Aug 22 19:19:27.221891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 100/191] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:27.314666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:27.322231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd976d6f-c80a-4b10-ad44-3cabee4a90a1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.146749 Aug 22 19:19:27.322797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 92/192] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:27.328954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:27.329497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:27.335254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:27.335762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:27.336193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:27.336873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:27.337321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:27.337734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:27.465844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:27.473329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e9514e02-a11e-405b-8340-b82341e3b35e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.148230 Aug 22 19:19:27.473881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 101/193] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:27 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:27.689363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:27.689965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:27.696078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:27.696558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:27.696986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:27.697670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:27.698790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:27.699210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:27.827973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:27.835810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57fd71a4-fec5-4d5e-8bcc-cfb3785345f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.150219 Aug 22 19:19:27.836653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 93/194] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:27 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:28.242356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:28.242903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:28.248887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:28.249363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:28.249797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:28.250478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:28.250927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:28.251347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:28.342924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:28.343523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:28.350289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:28.350775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:28.351206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:28.352404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:28.352640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:28.353060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:28.418936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:28.426840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9dc55294-1c72-4f34-a27c-caeda0f41c8e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.188347 Aug 22 19:19:28.427409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 102/195] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:28 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:28.493172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:28.493715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:28.499902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:28.500380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:28.500806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:28.501481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:28.501923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:28.502333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:28.642109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:28.650299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d7d40c23-4d1d-48c0-b52b-8f21d29a3c5c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.160987 Aug 22 19:19:28.651024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 103/196] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:28 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:28.840192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:28.847573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f147e610-dcb6-45d5-9f21-e3b4e5ce14f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.509049 Aug 22 19:19:28.848161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 94/197] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:28.858082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:28.858705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:28.868880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:28.869654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:28.870830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:28.871836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:28.872429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:28.873106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:28.999492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:29.007111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0bd1fc7c-594a-4ba6-b191-31d3d79421a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.153917 Aug 22 19:19:29.007696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 104/198] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:28 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:29.447391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:29.448029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:29.453855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:29.454328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:29.454756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:29.455432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:29.455902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:29.456321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:29.585124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:29.588519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:29.593376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c3dd0fe-49a3-4d59-9eb7-3e1ba9177cf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.149801 Aug 22 19:19:29.593937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 95/199] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:29 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:29.672266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:29.672908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:29.678748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:29.679221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:29.679666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:29.680347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:29.680790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:29.681202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:29.809142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:29.816622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-15463593-5ee8-4956-8d85-d113c139a502 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.148084 Aug 22 19:19:29.817181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 105/200] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:29 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:29.869374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:29.869986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:29.876024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:29.876504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:29.876937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:29.877619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:29.878069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:29.878486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:30.005668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:30.013276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a5b4380-8950-46a3-a956-4b2d8dc3cad6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.147635 Aug 22 19:19:30.013862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 96/201] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:30.031106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:30.031739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:30.037614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:30.038088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:30.038515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:30.039193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:30.039633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:30.040073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:30.175783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:30.183292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-366989b2-cad5-4676-801d-2094a7980660 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.156340 Aug 22 19:19:30.183883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 106/202] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:30 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:30.614513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:30.615043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:30.621486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:30.621964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:30.622394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:30.623100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:30.623531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:30.623981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:30.750522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:30.757993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c84882f-4315-4b4f-a6be-24551684924b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.147418 Aug 22 19:19:30.758556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 97/203] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:30.836895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:30.837493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:30.843322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:30.843834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:30.844264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:30.844935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:30.845377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:30.845789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:30.971496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:30.979753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fcacc1fd-5f35-48cc-8844-59748c6031ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.146153 Aug 22 19:19:30.980328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 107/204] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:30 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:31.035004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:31.035606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:31.042013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:31.042500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:31.042933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:31.043618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:31.044095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:31.044519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:31.175336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:31.183403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dcd5a67c-de9e-49c7-89be-0f711e001637 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.152269 Aug 22 19:19:31.183994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 98/205] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:31.203916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:31.204550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:31.210386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:31.210855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:31.211281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:31.211984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:31.212428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:31.212838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:31.334837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:31.343312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-002a0a43-15ac-439f-bf2d-46e679e3f99f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.142710 Aug 22 19:19:31.343441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 108/206] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:31 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:31.778854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:31.779464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:31.785429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:31.785904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:31.786334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:31.787017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:31.787469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:31.787925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:31.914762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:31.924255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43fdcedc-588b-4944-87c0-087f307fe745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.149758 Aug 22 19:19:31.924828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 99/207] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:32.000471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:32.001078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:32.008565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:32.009058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:32.009493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:32.010184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:32.011272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:32.011720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:32.138884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:32.146491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eb55c7f5-cec3-49bd-bbaf-6890385a8a27 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.149747 Aug 22 19:19:32.147493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 109/208] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:31 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:32.204566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:32.205277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:32.211091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:32.211571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:32.212032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:32.212706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:32.213144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:32.213596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:32.348471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:32.356730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-387b7d7a-e836-4a69-8e3e-a1836be3916d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.155940 Aug 22 19:19:32.357298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 100/209] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:32.364125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:32.364728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:32.371232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:32.371891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:32.372147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:32.372825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:32.373273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:32.373688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:32.503434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:32.510936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-62c52a13-b493-4b40-b36b-a0daaef86891 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.150648 Aug 22 19:19:32.511492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 110/210] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:32 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:32.945350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:32.945947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:32.951740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:32.952213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:32.952639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:32.953311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:32.953754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:32.954168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:33.078536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:33.085943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f92e1e9-d896-462f-8497-712e763c661a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.144345 Aug 22 19:19:33.086510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 101/211] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:32 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:33.166216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:33.166826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:33.172719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:33.173198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:33.173629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:33.174341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:33.174785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:33.175204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:33.300003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:33.307525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f3b1202e-ff99-41ec-9da9-f9a392806ab6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.145125 Aug 22 19:19:33.308111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 111/212] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:33 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:33.377969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:33.378572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:33.384441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:33.384915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:33.385857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:33.386533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:33.386981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:33.387395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:33.518281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:33.525841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b12fdc1-99b7-4a69-b77a-f79f93c50dc2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.151680 Aug 22 19:19:33.526397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 102/213] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:33 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:33.531551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:33.532197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:33.538408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:33.538887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:33.539320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:33.540074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:33.540557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:33.540980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:33.668116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:33.675635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c6fcd06e-33cb-4f21-9bcd-f461fda190f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.147916 Aug 22 19:19:33.676593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 112/214] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:33 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:33.830608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-18e5dcc0-375b-4a28-bed5-d75fa6b77ada req-68a95b39-ff1b-4e39-a7aa-10a04368da59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811f9039-8449-4f72-9793-bf132dd4b093", "name": "network-vif-plugged", "status": "completed", "tag": "296f73cc-ce7e-4239-b7b5-5c89f1e78d0b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:19:33.840470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18e5dcc0-375b-4a28-bed5-d75fa6b77ada req-68a95b39-ff1b-4e39-a7aa-10a04368da59 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:33.840949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18e5dcc0-375b-4a28-bed5-d75fa6b77ada req-68a95b39-ff1b-4e39-a7aa-10a04368da59 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:33.841382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-18e5dcc0-375b-4a28-bed5-d75fa6b77ada req-68a95b39-ff1b-4e39-a7aa-10a04368da59 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:33.853294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-18e5dcc0-375b-4a28-bed5-d75fa6b77ada req-68a95b39-ff1b-4e39-a7aa-10a04368da59 service nova] Creating event network-vif-plugged:296f73cc-ce7e-4239-b7b5-5c89f1e78d0b for instance 811f9039-8449-4f72-9793-bf132dd4b093 on hv-cinder-83538 Aug 22 19:19:33.859200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-18e5dcc0-375b-4a28-bed5-d75fa6b77ada req-68a95b39-ff1b-4e39-a7aa-10a04368da59 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032316 Aug 22 19:19:33.859805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 103/215] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:19:34.106904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:34.107517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:34.113411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:34.113886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:34.114313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:34.115000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:34.115444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:34.115895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:34.241340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:34.249482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2aef993a-11ad-4d39-97e7-dc044daa3fe5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.146865 Aug 22 19:19:34.250040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 113/216] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:34.328563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:34.329258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:34.335454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:34.335976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:34.336404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:34.337084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:34.337532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:34.337952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:34.472579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:34.481085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5109253c-fcac-4e2f-ac6a-63b203c8df47 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.156833 Aug 22 19:19:34.481642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 104/217] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:34 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:34.547339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:34.547978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:34.553989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:34.554470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:34.554903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:34.555617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:34.556099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:34.556537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:34.686256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:34.689684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:34.694748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5ff9f2a4-bd6e-4fdb-b0b6-8d534626cfce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.151139 Aug 22 19:19:34.695316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 114/218] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:34.696285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:34.696887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:34.703214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:34.703722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:34.704156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:34.704878 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:34.705324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:34.705745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:34.834207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:34.842759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d2f2fc0-9431-4218-b86f-34c68c081712 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.150229 Aug 22 19:19:34.843324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 105/219] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:34 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:35.269139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:35.269747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:35.276310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:35.276859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:35.277120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:35.277796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:35.278243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:35.278657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:35.420134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:35.428083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-78fed9cb-2399-42fe-b41a-21f8ae680d4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.162839 Aug 22 19:19:35.428689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 115/220] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:35 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:35.503467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:35.504182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:35.512704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:35.518171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:35.518171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:35.518171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:35.518171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:35.518457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:35.668314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:35.677986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4bb26297-e62a-4963-a8b2-f617225d618d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.180062 Aug 22 19:19:35.678574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 106/221] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:35 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:35.715506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:35.716131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:35.722629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:35.723339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:35.724007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:35.724975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:35.725600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:35.726195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:35.865824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:35.867176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:35.878115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:35.878615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:35.881142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:35.882092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:35.883705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:35.884947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:35.888473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:35.897424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-940ac101-4629-432c-84dd-8443f461c5a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.185823 Aug 22 19:19:35.898652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 116/222] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:36.066446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:36.074557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c60bfb6-fa4a-4324-a4f9-ad734712a91e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.214316 Aug 22 19:19:36.075120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 107/223] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:35 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:36.449518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:36.450117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:36.456930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:36.457620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:36.458052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:36.458736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:36.459180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:36.459590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:36.610230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:36.618159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4a65bb28-86d9-4603-bfd7-b0cb3fec0cb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.172888 Aug 22 19:19:36.624029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 117/224] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:36.701906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:36.703251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:36.714071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:36.714594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:36.715118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:36.716337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:36.717082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:36.717719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:36.913119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:36.918851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:36.920208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:36.939486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:36.941755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:36.942685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:36.944303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:36.946066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:36.947023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:36.950946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44af4731-a4fa-4f0c-90f9-83ad7c741461 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.253629 Aug 22 19:19:36.952603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 108/225] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:36 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:37.095481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:37.096117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:37.103598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:37.106759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:37.108994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:37.110089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:37.110980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:37.112130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:37.179036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:37.187326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e6bc887a-b45e-498e-bf9b-e52a61d7476a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.272816 Aug 22 19:19:37.200289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 118/226] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:37.297504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:37.307250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e3f0edb5-c519-4ea3-9407-d297564c95cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.215368 Aug 22 19:19:37.308405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 109/227] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:37 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:37.640635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:37.642788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:37.663598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:37.665334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:37.667838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:37.668809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:37.670954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:37.672614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:37.875896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:37.884537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-27a9b319-b4d1-48ca-bb82-3d1adf13640d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.250084 Aug 22 19:19:37.885848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 119/228] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:37.974141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:37.975587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:37.982089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:37.982570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:37.983219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:37.983959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:37.984406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:37.985048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:38.207772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:38.208995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:38.215631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:38.216186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:38.216842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:38.217636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:38.218149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:38.218636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:38.218839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:38.227812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5030b82a-7e28-4814-9fd5-187cdb2ec398 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.257608 Aug 22 19:19:38.228390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 110/229] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:37 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:38.329933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:38.331157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:38.346154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:38.347796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:38.350070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:38.351052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:38.353420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:38.355361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:38.400066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:38.412635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-01420bf4-ca61-4633-bdc7-a9b1d029fb8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.208490 Aug 22 19:19:38.413880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 120/230] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:38.608348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:38.621646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cfb260dd-6e6c-4e3e-8851-c4b4f4c0ad61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.296741 Aug 22 19:19:38.622842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 111/231] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:38 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:38.907103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:38.908330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:38.917923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:38.918612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:38.919794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:38.921297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:38.922106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:38.922720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:39.147835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:39.160065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-88504dbf-cd63-4545-be79-ca492c79be4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.257251 Aug 22 19:19:39.162336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 121/232] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:39.248414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:39.249030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:39.258705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:39.259209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:39.259687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:39.260943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:39.261400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:39.261820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:39.435123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:39.435812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:39.442800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:39.443530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:39.444004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:39.444707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:39.445156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:39.445905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:39.461057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:39.473092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-56a5692e-f9a1-4cbf-8190-5eeb5a0b7a05 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.228058 Aug 22 19:19:39.473837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 112/233] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:39 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:39.595569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:39.603476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-29006d70-85f4-4ee4-93b6-54b6f763840e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.172775 Aug 22 19:19:39.604098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 122/234] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:39.642436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:39.643223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:39.650104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:39.650434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:39.655472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:39.656563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:39.657709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:39.658557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:39.664659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:39.803815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:39.812398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb9d9fad-f3b5-4da5-9945-f5988929bdf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.173649 Aug 22 19:19:39.812961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 113/235] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:39 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:40.183195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:40.183902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:40.189989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:40.190483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:40.191108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:40.191706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:40.192497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:40.193881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:40.361406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:40.370915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f89cc416-10e6-4e84-96cf-6ce12a4a1754 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.192136 Aug 22 19:19:40.377825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 123/236] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:40.498470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:40.499632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:40.507801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:40.508291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:40.508910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:40.509780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:40.510281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:40.510719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:40.623298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:40.624301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:40.630199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:40.630674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:40.631335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:40.632054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:40.632506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:40.632911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:40.649421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:40.660102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c9b2345-a03e-4b75-9ac9-94cd1a91371d tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.166418 Aug 22 19:19:40.671996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 114/237] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:40 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:40.768778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:40.777085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c35ef237-d9f0-4c62-b857-7653c13bc0d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.157622 Aug 22 19:19:40.777658 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 124/238] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:40.833836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:40.834451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:40.841091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:40.841585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:40.842024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:40.842716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:40.843220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:40.843720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:40.970831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:40.979001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d6ab0fac-c547-48ba-a3a7-ffc106db0d00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.148955 Aug 22 19:19:40.979944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 115/239] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:40 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:41.399140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:41.399840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:41.405810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:41.406289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:41.406717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:41.407400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:41.407873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:41.408289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:41.544484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:41.552288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-127fba27-87d4-4126-b00c-ef3bca454b40 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.157171 Aug 22 19:19:41.552850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 125/240] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:41.680481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:41.681081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:41.687368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:41.687885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:41.688311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:41.688988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:41.689429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:41.689845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:41.798152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:41.799248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:41.805441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:41.806132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:41.806629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:41.807947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:41.808560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:41.809211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:41.831393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:41.857492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-872d9e6a-89bf-4a60-93bc-1ae806238db3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.180673 Aug 22 19:19:41.858262 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 116/241] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:41 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:41.980434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:41.989205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2d446c25-bfc1-42fc-8fef-49a33123a19e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.195474 Aug 22 19:19:41.989893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 126/242] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:41 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:42.007570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:42.008692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:42.015718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:42.016207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:42.016647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:42.017345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:42.017807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:42.018227 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:42.180719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:42.188336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca95236f-c424-430c-be88-7f0623d52399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.184662 Aug 22 19:19:42.188901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 117/243] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:42 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:42.576224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:42.577218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:42.583085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:42.583602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:42.584090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:42.584792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:42.585246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:42.585670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:42.721526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:42.729911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-77e30030-1fa0-4751-bae8-5f8e8b556788 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.159464 Aug 22 19:19:42.730479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 127/244] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:42.879031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:42.879669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:42.886108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:42.886781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:42.887218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:42.887959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:42.888410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:42.888833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:43.011894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:43.012638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:43.019089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:43.019580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:43.020042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:43.020744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:43.021346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:43.021778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:43.044955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:43.054933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-800ee81c-909c-43f7-8a98-6ee942c5a125 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.180972 Aug 22 19:19:43.055769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 118/245] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:42 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:43.182905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:43.190967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9b1529df-411c-4847-b483-e413e284b11b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.184699 Aug 22 19:19:43.191548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 128/246] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:43 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:43.210074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8321e45f-e66f-4bb9-9c0c-b770dad9da22 req-275de700-9205-4ea6-8c0b-e0e8f9b2384b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604c6a93-ddc1-4f33-81a5-f431e35b16a8", "name": "network-vif-plugged", "status": "completed", "tag": "933102e5-36e2-4542-aa35-4f53ab839827"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:19:43.210560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:43.211176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:43.218419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:43.219114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:43.219923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:43.221381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:43.221593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:43.222226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:43.223504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:43.224254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8321e45f-e66f-4bb9-9c0c-b770dad9da22 req-275de700-9205-4ea6-8c0b-e0e8f9b2384b service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:43.225221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8321e45f-e66f-4bb9-9c0c-b770dad9da22 req-275de700-9205-4ea6-8c0b-e0e8f9b2384b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:43.226509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8321e45f-e66f-4bb9-9c0c-b770dad9da22 req-275de700-9205-4ea6-8c0b-e0e8f9b2384b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:43.245805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8321e45f-e66f-4bb9-9c0c-b770dad9da22 req-275de700-9205-4ea6-8c0b-e0e8f9b2384b service nova] Creating event network-vif-plugged:933102e5-36e2-4542-aa35-4f53ab839827 for instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 on hv-cinder-83538 Aug 22 19:19:43.253456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8321e45f-e66f-4bb9-9c0c-b770dad9da22 req-275de700-9205-4ea6-8c0b-e0e8f9b2384b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046623 Aug 22 19:19:43.254250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 119/247] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:19:43.367093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:43.374921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fa2a9bf1-8863-4bc2-9889-9df60391fb79 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.168582 Aug 22 19:19:43.375489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 129/248] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:43 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:43.648552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1309675109", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:19:43.708327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] validate_networks() for None {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:19:43.751426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:43.753044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:43.759990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:43.760822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:43.761459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:43.762527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:43.763244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:43.763906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:44.060695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:44.070685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a21cf756-561b-412f-af79-a2be1c77f016 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.323145 Aug 22 19:19:44.071519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 130/249] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:44.085278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:44.086176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:44.092655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:44.093137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:44.093596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:44.094434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:44.094880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:44.095290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:44.119049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:44.245960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:19:44.246507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:19:44.246676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:44.246897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:19:44.247286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:19:44.247719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:19:44.255321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e38c5fd7-9cae-4fa2-9fc3-7d5ca1cb63fe tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.177748 Aug 22 19:19:44.267970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:44.267970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:44.267970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:44.267970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:44.268241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:44.268241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:44.269541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 131/250] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:44 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:44.276113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:44.276579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:44.277516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Getting quotas for project 1e9f4c09721e4206869bbc0e49f9ab50. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:19:44.281835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Getting quotas for user 01a14c36af46451884400a5b8db1702d and project 1e9f4c09721e4206869bbc0e49f9ab50. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:19:44.283088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:44.283578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:44.284052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:44.284736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:44.285424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:44.285887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:44.294651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:19:44.297230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:19:44.346325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a45d78b-aac9-4273-a000-9301473e84e1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701968 Aug 22 19:19:44.346964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 120/251] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:19:44.366155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-200881c1-cef0-4589-af31-4e6d265f46dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:44.368885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-200881c1-cef0-4589-af31-4e6d265f46dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:44.431346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-200881c1-cef0-4589-af31-4e6d265f46dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:44.441006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-200881c1-cef0-4589-af31-4e6d265f46dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1215 microversion: 2.1 time: 0.079011 Aug 22 19:19:44.441588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 121/252] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:44 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:44.448806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:44.448806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:44.449511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:44.455563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:44.456094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:44.456534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:44.457242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:44.457813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:44.458243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:44.458916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-be01836a-c2c7-48c9-b467-00e85cf31bf8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.188154 Aug 22 19:19:44.459525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 132/253] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:44 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:44.604580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:44.616106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95c2760c-2c8a-4bb3-9563-ce7409a77b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.171325 Aug 22 19:19:44.623814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 122/254] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:44 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:45.090835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:45.091521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:45.098276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.099085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.099605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.100618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.100880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.101326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.266009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:45.277352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-60f6236a-db8c-4bc2-87d3-d788aa76677f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.190665 Aug 22 19:19:45.281188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:45.281806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:45.288173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.288667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.289214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.290064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.290632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.291113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 133/255] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:45 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:45.292064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.465927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:45.466543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:45.473439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.475191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.475191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.475191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.475597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.475782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.551282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:45.559193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-97201cbf-7eb1-46ac-aa58-73a657597caf tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1219 microversion: 2.1 time: 0.101079 Aug 22 19:19:45.559788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 134/256] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:45 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:45.564346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:45.565006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:45.571422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.572026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.572538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.573899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.574265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.577802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.647787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:45.656693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62940a14-5d93-4978-b069-18863354dd19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.379979 Aug 22 19:19:45.657482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 123/257] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:45 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:45.662167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:45.663002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:45.670443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.671177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.671886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.672770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:45.673223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:45.673639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:45.717534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:45.725999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-79804569-2757-4a09-8176-50baa370c6d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.165219 Aug 22 19:19:45.726835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 135/258] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:45 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:45.815230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:45.823501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42f2a654-8acd-46ec-994c-e86f5d12031e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.164974 Aug 22 19:19:45.824149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 124/259] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:45 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:46.298276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:46.299056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:46.305758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.306382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.306822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.307516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.307990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.308432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.437875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:46.445454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-aaa499be-e413-46eb-a8a7-12c8783397a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.151159 Aug 22 19:19:46.446121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 136/260] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:46.581039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:46.581722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:46.589067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.589869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.590282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.590975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.591426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.591879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.654479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:46.662029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff73d68e-b2f1-436c-a941-78afb27e149f tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1219 microversion: 2.1 time: 0.084881 Aug 22 19:19:46.662637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 125/261] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:46 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:46.678703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:46.679309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:46.686153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.686628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.687058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.687772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.688423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.688845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.748792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:46.749397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:46.756978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.757548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.758058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.759754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.759955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.760626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.827364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:46.835144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b4e0807c-2fdf-477e-900d-c31b39232d17 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.160459 Aug 22 19:19:46.835664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 137/262] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:46 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:46.846830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:46.848004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:46.852013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:46.856924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.857405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.858139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.858836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:46.859320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:46.859795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:46.940470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:46.948879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f16874a7-0454-42b3-a5a0-e83fe87b69f1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.204739 Aug 22 19:19:46.949665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 126/263] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:46 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:46.991497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:46.999294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-767b7ced-e857-4d97-9c24-681f825afe69 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.157340 Aug 22 19:19:47.005605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 138/264] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:46 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:47.466252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:47.467066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:47.473093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:47.473579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:47.474010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:47.474697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:47.475146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:47.475564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:47.605449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:47.613551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e8356fe-69d0-4e1d-9134-25b0818cc196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.151651 Aug 22 19:19:47.614256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 127/265] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:47.682343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:47.683028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:47.688918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:47.689390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:47.689817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:47.690496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:47.690973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:47.691387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:47.752879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:47.761058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9bc97bd5-20bc-46fb-86fa-b2c67d029079 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1219 microversion: 2.1 time: 0.082170 Aug 22 19:19:47.761826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 139/266] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:47 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:47.857247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:47.857853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:47.863742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:47.864221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:47.864676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:47.865360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:47.865803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:47.866222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:47.970731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:47.972179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:47.979604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:47.980189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:47.980860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:47.981730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:47.982377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:47.982938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:48.005952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:48.023575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2197e494-dea1-4dbb-ada8-019ab76e7ea3 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.172437 Aug 22 19:19:48.035837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 128/267] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:47 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:48.035837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:48.035837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:48.036561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:48.036561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:48.036998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:48.037676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:48.038122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:48.038534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:48.141656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:48.151604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-66406fef-fd5a-48ae-8504-651c0e0a7a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.185281 Aug 22 19:19:48.152318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 140/268] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:47 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:48.181762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:48.189852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-542e631f-831e-46f9-a4b0-6e76bd8b6f89 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.164657 Aug 22 19:19:48.190417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 129/269] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:48 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:48.633777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:48.634378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:48.640931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:48.641474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:48.641980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:48.642720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:48.643315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:48.643772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:48.780995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:48.781900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:48.785685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:48.788504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:48.789210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:48.789646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:48.790348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:48.790791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:48.791209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:48.793674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ce150851-b159-447f-88f7-bf3bf86d6ad8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.163666 Aug 22 19:19:48.794228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 141/270] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:48.856564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:48.863980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1c5330e-081b-4adc-b802-9f6908918010 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1219 microversion: 2.1 time: 0.086811 Aug 22 19:19:48.864534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 130/271] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:48 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:49.048810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:49.049489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:49.055264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.055777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.056206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.056938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.057385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.057802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.171788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:49.172400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:49.178327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.178813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.179241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.179990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.180436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.180855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.234531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:49.244664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d8c92347-82d3-42b0-b5b9-d5d168f8ec80 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.199584 Aug 22 19:19:49.245844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 142/272] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:49 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:49.254446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:49.255205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:49.263553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.264189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.264740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.265527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.266209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.266726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.336921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:49.345696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e184e685-1e79-478f-a9b7-f8634784a8a9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.177628 Aug 22 19:19:49.346262 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 131/273] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:49 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:49.403597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:49.411220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b3838745-e1fe-4786-ae41-2bc4b4659667 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.164114 Aug 22 19:19:49.411805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 143/274] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:49 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:49.813719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:49.814510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:49.820489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.820965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.821396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.822072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.822699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.823113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.827082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:49.885617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:49.886276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:49.892482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.893043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.893646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.894492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:49.895090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:49.895516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:49.961422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:49.964471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:49.969485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f977ed37-2f01-4607-abc7-04551a0c0662 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1219 microversion: 2.1 time: 0.087703 Aug 22 19:19:49.970056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 144/275] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:49 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:49.973280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4fa5b85c-7276-4e48-8c86-9e5c3be006c1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.163373 Aug 22 19:19:49.984799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 132/276] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:50.265833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:50.266219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:50.272080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:50.272902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:50.273341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:50.274032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:50.274477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:50.275035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:50.366053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:50.367018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:50.373198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:50.373676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:50.374117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:50.375249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:50.375249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:50.375658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:50.408067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:50.418979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8017a4f8-6e25-4961-bb63-286357f906f4 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.157014 Aug 22 19:19:50.419562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 145/277] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:50 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:50.433816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:50.434487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:50.440786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:50.441404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:50.441839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:50.442691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:50.443139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:50.443555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:50.514454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:50.523806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a96aec59-6c10-4cc5-a4a1-282dccd34b76 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.161385 Aug 22 19:19:50.524374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 133/278] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:50 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:50.581530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:50.589922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f192e665-e195-49d4-a1f6-d0b1b905e516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.161225 Aug 22 19:19:50.590843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 146/279] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:50 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:50.990123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:50.991108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:50.996536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:50.997144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:50.998699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:50.999272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:50.999815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.000590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:51.001404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:51.007074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.007557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:51.008260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:51.008703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.009436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:51.009918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:51.010926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.085130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:51.095581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce63514d-dc42-4461-a72f-64b68361fb90 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1219 microversion: 2.1 time: 0.108193 Aug 22 19:19:51.096451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 134/280] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:50 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:51.190838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:51.199772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1bde6100-d3b4-4c65-9cf4-e9d3f355bd62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.207310 Aug 22 19:19:51.200482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 147/281] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:50 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:51.441280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:51.442122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:51.448211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:51.448784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:51.449383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.450135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:51.450657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:51.451134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.546664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:51.547215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:51.554826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:51.556020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:51.556603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.557938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:51.558534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:51.559475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.565878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:51.608769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:51.617291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-46256cf7-e566-456c-a890-756af249711c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.180232 Aug 22 19:19:51.618404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 135/282] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:51 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:51.623274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:51.624086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:51.630427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:51.631115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:51.631728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.632838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:51.633483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:51.633976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:51.734514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:51.744004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1cf7e456-a63c-4b04-893f-b6aed23d00f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1366 microversion: 2.1 time: 0.203101 Aug 22 19:19:51.744998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 148/283] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:51 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:51.800776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:51.808664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-917af606-53af-45b7-9b3c-32e6d0687570 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.189154 Aug 22 19:19:51.821952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 136/284] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:51 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:52.123891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:52.124553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:52.130929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.131756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.132187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.133032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.133652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.134217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.215006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:52.225956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:52.227027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:52.244426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.244984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.245437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.246145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.246620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.248814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d68a9743-9fde-4663-932c-15bf605d9a42 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1219 microversion: 2.1 time: 0.133618 Aug 22 19:19:52.249778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 149/285] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:52 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:52.249891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.379324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:52.386932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c510d472-fd93-461e-8236-74bebcd57e64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.168179 Aug 22 19:19:52.387506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 137/286] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:52.638157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:52.638664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:52.644467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.644939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.645365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.646042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.646484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.646898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.766732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:52.767502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:52.774588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.775125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.775557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.776464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.777117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.777690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.797849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:52.812710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-39b00eb3-7afc-472d-a043-b3124638444f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.177751 Aug 22 19:19:52.813950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 150/287] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:52 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:52.833320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:52.833977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:52.840841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.841321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.841966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.842874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:52.843477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:52.844134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:52.973012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:52.983783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1645c4d1-9b0b-40a2-abe6-550fd7fd96bf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1556 microversion: 2.1 time: 0.222000 Aug 22 19:19:52.999433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 138/288] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:52 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1556 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:53.005271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4560ac77-54d1-4a19-9f58-dc540ad22484 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:53.005826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4560ac77-54d1-4a19-9f58-dc540ad22484 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:53.014345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:53.022557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7d0785e3-04f4-435b-8b31-f2f6ec588228 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.195879 Aug 22 19:19:53.027442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 151/289] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:52 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:53.027620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4560ac77-54d1-4a19-9f58-dc540ad22484 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:53.028431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4560ac77-54d1-4a19-9f58-dc540ad22484 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:53.029027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4560ac77-54d1-4a19-9f58-dc540ad22484 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:53.029966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4560ac77-54d1-4a19-9f58-dc540ad22484 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:53.030836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4560ac77-54d1-4a19-9f58-dc540ad22484 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:53.031487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4560ac77-54d1-4a19-9f58-dc540ad22484 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:53.195776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4560ac77-54d1-4a19-9f58-dc540ad22484 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194238 Aug 22 19:19:53.196650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 139/290] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Aug 22 19:19:52 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:19:53.269986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:53.270763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:53.278322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:53.279753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:53.284380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:53.285189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:53.287848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:53.289781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:53.407911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:53.408892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:53.414911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:53.415517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:53.416077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:53.417041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:53.417556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:53.418039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:53.449384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:53.464262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0d9a6c6a-d289-4661-a4da-f10c2855073a tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1211 microversion: 2.1 time: 0.198010 Aug 22 19:19:53.466189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 152/291] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:53 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1211 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:53.610555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:53.619292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb04f5e2-7f6d-4935-9fe8-d3da94d90201 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.215318 Aug 22 19:19:53.620318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 140/292] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:53.833711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:53.835340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:53.843242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:53.843929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:53.844668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:53.845522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:53.846118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:53.846684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:54.048660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:54.049438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:54.056675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:54.058027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:54.058721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:54.059741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:54.060938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:54.061082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:54.269110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:54.282330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:54.290688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3e2fde6c-b5b6-451b-ab14-a1e0103257ad tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.460886 Aug 22 19:19:54.293645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 153/293] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:53 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:54.434516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:54.437556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:19:54.446131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7f3a15c-9c6d-4b66-a479-442e67f4e8f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.401672 Aug 22 19:19:54.454739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 141/294] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:54 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:54.488177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:54.488975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:54.498797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:54.500657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:54.502603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:54.505071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:54.506555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:54.507738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:54.612722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:54.621710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-698b76f1-bf17-49d0-b86b-96c7d466cb74 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1211 microversion: 2.1 time: 0.138968 Aug 22 19:19:54.627719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 154/295] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:54 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1211 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:54.643309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:54.644045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:54.650449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:54.651763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:54.652412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:54.653321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:54.654049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:54.654698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:54.940206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:54.957968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8558a23e-0955-49e7-84af-70c102806b49 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1362 microversion: 2.1 time: 0.319995 Aug 22 19:19:54.958440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-017f214e-fe34-4f74-9fcb-88e4db3584b6 req-e7280a5f-b06d-4f4b-bfd7-6f43e55c3b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b95c1a3-7046-4ae9-aec5-fb8838e1d45e", "tag": "9c89ecbc-8920-445b-bd9b-563d448b3243"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:19:54.960785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 142/296] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:54.985987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-017f214e-fe34-4f74-9fcb-88e4db3584b6 req-e7280a5f-b06d-4f4b-bfd7-6f43e55c3b1a service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:54.987152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-017f214e-fe34-4f74-9fcb-88e4db3584b6 req-e7280a5f-b06d-4f4b-bfd7-6f43e55c3b1a service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:54.988590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-017f214e-fe34-4f74-9fcb-88e4db3584b6 req-e7280a5f-b06d-4f4b-bfd7-6f43e55c3b1a service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:55.008134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-017f214e-fe34-4f74-9fcb-88e4db3584b6 req-e7280a5f-b06d-4f4b-bfd7-6f43e55c3b1a service nova] Creating event network-changed:9c89ecbc-8920-445b-bd9b-563d448b3243 for instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e on hv-cinder-83538 Aug 22 19:19:55.014699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-017f214e-fe34-4f74-9fcb-88e4db3584b6 req-e7280a5f-b06d-4f4b-bfd7-6f43e55c3b1a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060108 Aug 22 19:19:55.015499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 155/297] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:19:55.316089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:55.317463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:55.326882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:55.329270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:55.329921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:55.331006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:55.331931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:55.333590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:55.475577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:55.477814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:55.500318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:55.500838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:55.501332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:55.502099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:55.505496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:55.505496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:55.717752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:55.742858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-065c1376-6d48-4ca7-bbe6-667057c70591 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1314 microversion: 2.1 time: 0.424618 Aug 22 19:19:55.744155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 143/298] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:55 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:55.757647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:55.758972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:55.795752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:55.799504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:55.800434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:55.802298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:55.805235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:55.805696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:55.878455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:55.888921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-837ba590-4876-4987-abf4-ba661bca62d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.416456 Aug 22 19:19:55.897367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 156/299] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:55 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:55.902749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-f606e475-411e-47f7-a63d-1a9a7e6325c2 req-e2c33c0a-c16c-4b0b-93d2-7cdc22689a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d520aec1-59d4-4169-9eea-84ec30203610", "name": "network-vif-plugged", "status": "completed", "tag": "d79a28ec-9fd6-4fed-bcad-77de1d3b3f63"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:19:55.926514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-f606e475-411e-47f7-a63d-1a9a7e6325c2 req-e2c33c0a-c16c-4b0b-93d2-7cdc22689a99 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:55.928512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:55.928927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-f606e475-411e-47f7-a63d-1a9a7e6325c2 req-e2c33c0a-c16c-4b0b-93d2-7cdc22689a99 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:55.929530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-f606e475-411e-47f7-a63d-1a9a7e6325c2 req-e2c33c0a-c16c-4b0b-93d2-7cdc22689a99 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:55.936996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6990790b-04f2-4317-879d-54b6880feb8b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1267 microversion: 2.1 time: 0.188778 Aug 22 19:19:55.937582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 144/300] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:55 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:55.944523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-f606e475-411e-47f7-a63d-1a9a7e6325c2 req-e2c33c0a-c16c-4b0b-93d2-7cdc22689a99 service nova] Creating event network-vif-plugged:d79a28ec-9fd6-4fed-bcad-77de1d3b3f63 for instance d520aec1-59d4-4169-9eea-84ec30203610 on hv-cinder-83538 Aug 22 19:19:55.953377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-f606e475-411e-47f7-a63d-1a9a7e6325c2 req-e2c33c0a-c16c-4b0b-93d2-7cdc22689a99 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051775 Aug 22 19:19:55.954085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 157/301] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:19:55.991381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:55.992506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:56.004906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:56.005627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:56.006275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:56.007131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:56.007725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:56.008595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:56.190895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:56.199634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f877120-0941-4b6c-be7a-58aea8e5cbb6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1548 microversion: 2.1 time: 0.218021 Aug 22 19:19:56.200537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 145/302] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:55 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1548 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:56.221795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-45784259-1e6d-4319-8a06-0ff97dfef49b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:56.222566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-45784259-1e6d-4319-8a06-0ff97dfef49b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:56.230290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45784259-1e6d-4319-8a06-0ff97dfef49b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:56.230979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45784259-1e6d-4319-8a06-0ff97dfef49b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:56.231581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45784259-1e6d-4319-8a06-0ff97dfef49b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:56.232324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45784259-1e6d-4319-8a06-0ff97dfef49b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:56.232856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45784259-1e6d-4319-8a06-0ff97dfef49b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:56.233441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45784259-1e6d-4319-8a06-0ff97dfef49b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:56.362965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-45784259-1e6d-4319-8a06-0ff97dfef49b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145218 Aug 22 19:19:56.363999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 158/303] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Aug 22 19:19:56 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:19:56.765557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:56.766168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:56.776349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:56.777408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:56.778511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:56.779945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:56.783373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:56.784368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:56.911454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:56.912725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:56.923073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:56.923882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:56.924514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:56.925445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:56.928411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:56.929052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:57.191381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:57.201067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-15a09568-6a4d-4f18-a15a-ed1ae5976803 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.293257 Aug 22 19:19:57.201628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 159/304] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:56 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:19:57.215605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:57.216952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:57.224377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:57.225024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:57.225597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:57.226469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:57.227179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:57.227599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:57.300792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:57.309232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-99b8a68f-4719-4e35-b71f-aa57e4e7808b tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1275 microversion: 2.1 time: 0.106416 Aug 22 19:19:57.309952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 160/305] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:57 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1275 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:57.939986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:57.954940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b0d8ec1-1007-4d0e-ba6f-ef418c4d8973 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1502 microversion: 2.1 time: 1.192537 Aug 22 19:19:57.956437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 146/306] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:56 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1502 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:58.222999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:58.224319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:58.232578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:58.233973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:58.234405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:58.235114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:58.235564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:58.236004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:58.331301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:58.332177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:58.348354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:58.349121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:58.350036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:58.356179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:58.356708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:58.357149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:58.435006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:58.445197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f2716ed3-de73-4698-84f6-7dc53d56aad2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.226842 Aug 22 19:19:58.449503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 161/307] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:58 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:58.529512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:58.543462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1571d5d8-d4c0-4027-af9b-f2a007c45ecd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1273 microversion: 2.1 time: 0.216761 Aug 22 19:19:58.548857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 147/308] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:58 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:19:59.207246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-e03f2519-101b-422e-b2d8-e5ac8cbd8b05 req-3264644e-30f0-436d-a01e-3f1e045a747e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604c6a93-ddc1-4f33-81a5-f431e35b16a8", "tag": "933102e5-36e2-4542-aa35-4f53ab839827"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:19:59.225472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-e03f2519-101b-422e-b2d8-e5ac8cbd8b05 req-3264644e-30f0-436d-a01e-3f1e045a747e service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:59.226059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-e03f2519-101b-422e-b2d8-e5ac8cbd8b05 req-3264644e-30f0-436d-a01e-3f1e045a747e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:59.227258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-e03f2519-101b-422e-b2d8-e5ac8cbd8b05 req-3264644e-30f0-436d-a01e-3f1e045a747e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:59.252025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-e03f2519-101b-422e-b2d8-e5ac8cbd8b05 req-3264644e-30f0-436d-a01e-3f1e045a747e service nova] Creating event network-changed:933102e5-36e2-4542-aa35-4f53ab839827 for instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 on hv-cinder-83538 Aug 22 19:19:59.266075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-e03f2519-101b-422e-b2d8-e5ac8cbd8b05 req-3264644e-30f0-436d-a01e-3f1e045a747e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063034 Aug 22 19:19:59.269150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 162/309] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:19:59.470604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:59.471840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:59.484224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:59.486873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:59.487363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:59.488237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:59.488575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:59.492117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:59.571666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:19:59.572614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:19:59.590853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:59.594351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:59.594665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:59.595387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:19:59.600370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:19:59.600879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:19:59.682269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:19:59.692365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5a364bb8-08f9-4158-9ea7-fa2f9ffb4e8e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1273 microversion: 2.1 time: 0.126518 Aug 22 19:19:59.710762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 163/310] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:59 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:00.194182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:00.202160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0208bc7-6aee-4855-a597-0bb5f1cea626 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1322 microversion: 2.1 time: 0.736569 Aug 22 19:20:00.202740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 148/311] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:19:59 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:00.717762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3e2e959c-99a0-4dad-b5fa-2406ba858b46 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0833f379-14bd-4792-bf56-8be16feac3be"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:20:00.718405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:00.721892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:00.726766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3e2e959c-99a0-4dad-b5fa-2406ba858b46 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:00.733123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2e959c-99a0-4dad-b5fa-2406ba858b46 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:00.733917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2e959c-99a0-4dad-b5fa-2406ba858b46 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:00.735741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2e959c-99a0-4dad-b5fa-2406ba858b46 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:00.736557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2e959c-99a0-4dad-b5fa-2406ba858b46 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:00.737220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2e959c-99a0-4dad-b5fa-2406ba858b46 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:00.737841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e2e959c-99a0-4dad-b5fa-2406ba858b46 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:00.747658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:00.751544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:00.752218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:00.757845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:00.758401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:00.758843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:00.775250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:01.401667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:01.437567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13f6ca6f-f2d7-4339-b4d7-a9a48dbc2748 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.723123 Aug 22 19:20:01.438880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 149/312] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:00 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:01.456829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:01.457785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:01.466169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:01.466684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:01.467309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:01.468536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:01.469198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:01.469784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:01.800640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3e2e959c-99a0-4dad-b5fa-2406ba858b46 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "POST /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.086819 Aug 22 19:20:01.801850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 164/313] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Aug 22 19:20:00 2022] POST /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093/os-volume_attachments => generated 194 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:01.960846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:01.979295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83372b66-7e64-470f-8bec-782effd4a5f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1515 microversion: 2.1 time: 0.538557 Aug 22 19:20:01.995780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 150/314] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:01 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1515 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:02.008120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:20:02.014389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:02.024209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:02.025491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:02.027132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:02.028145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:02.028868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:02.029494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:02.066348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'flavor' on Instance uuid d520aec1-59d4-4169-9eea-84ec30203610 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:20:02.095179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:02.245815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9b563700-6683-425f-a7ef-05d8eda425fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610/action" status: 200 len: 32 microversion: 2.1 time: 0.243494 Aug 22 19:20:02.247027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 165/315] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:20:01 2022] POST /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610/action => generated 32 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 19:20:02.260478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:02.261399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:02.269115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:02.269333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:02.269776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:02.270488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:02.271073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:02.271493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:02.463102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:02.464257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:02.479968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:02.480481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:02.481173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:02.481909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:02.482367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:02.482797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:02.695330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:02.709070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eeece19a-754f-42e2-93fe-a7133e79c6ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.455690 Aug 22 19:20:02.710825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 151/316] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:02 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:02.719504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1a09afbc-8c7b-4947-b138-7e6f575b9ebe req-f2e5c69d-c6f9-4bdf-9fee-3f77eac883f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2b38de-cd5b-4f68-a492-a0caff6d2886", "tag": "4ed5711f-f822-4461-8df0-99f9a0a03eb3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:20:02.749715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1a09afbc-8c7b-4947-b138-7e6f575b9ebe req-f2e5c69d-c6f9-4bdf-9fee-3f77eac883f5 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:02.750211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1a09afbc-8c7b-4947-b138-7e6f575b9ebe req-f2e5c69d-c6f9-4bdf-9fee-3f77eac883f5 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:02.750643 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1a09afbc-8c7b-4947-b138-7e6f575b9ebe req-f2e5c69d-c6f9-4bdf-9fee-3f77eac883f5 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:02.766395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1a09afbc-8c7b-4947-b138-7e6f575b9ebe req-f2e5c69d-c6f9-4bdf-9fee-3f77eac883f5 service nova] Creating event network-changed:4ed5711f-f822-4461-8df0-99f9a0a03eb3 for instance dc2b38de-cd5b-4f68-a492-a0caff6d2886 on hv-cinder-83538 Aug 22 19:20:02.772013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1a09afbc-8c7b-4947-b138-7e6f575b9ebe req-f2e5c69d-c6f9-4bdf-9fee-3f77eac883f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057843 Aug 22 19:20:02.773081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 152/317] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:02.821997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:02.832418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b8aff1dc-cea9-41a1-beb3-dc0e1390cfa1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.374771 Aug 22 19:20:02.833018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 166/318] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:02 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:03.734348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:03.735046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:03.741403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:03.741960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:03.742438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:03.743198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:03.743682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:03.744162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:03.854602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:03.855204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:03.861646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:03.862111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:03.862612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:03.863264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:03.863706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:03.864715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:04.001273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:04.010866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc8a3d14-88ee-4764-9f3b-ea950b1aea3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.280766 Aug 22 19:20:04.036524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 153/319] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:03 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:04.052921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:04.061255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9568f869-6b82-4c57-bc6d-7f32d05b55ba tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.210760 Aug 22 19:20:04.061818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 167/320] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:03 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:05.037439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:05.038042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:05.044081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:05.044564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:05.044994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:05.045710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:05.046163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:05.046782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:05.082729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:05.084478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:05.092318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:05.096188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:05.096868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:05.097811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:05.098422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:05.100544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:05.228543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:05.238045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d946625-c212-4612-8de9-3d6050a395b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.204375 Aug 22 19:20:05.239608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 154/321] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:05 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:05.275429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:05.283600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-83f957f7-9f29-47e2-935d-ba2a3b1722c1 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.205086 Aug 22 19:20:05.284202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 168/322] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:05 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:06.261235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:06.261961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:06.268168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:06.268649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:06.269084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:06.269770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:06.270217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:06.270646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:06.304146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:06.304766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:06.312761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:06.313253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:06.313688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:06.314397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:06.314921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:06.315358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:06.436824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:06.445416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38b50f1a-9edf-410f-9aaa-b05029d1dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.188469 Aug 22 19:20:06.446268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 155/323] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:06 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:06.489555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:06.497897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-94ce63aa-ab8c-46ca-a33f-0b944fa43b56 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.198117 Aug 22 19:20:06.499830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 169/324] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:06 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:07.467066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:07.467759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:07.473867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:07.474347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:07.474778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:07.475468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:07.475943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:07.476370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:07.524615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:07.525678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:07.532453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:07.532929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:07.533359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:07.534129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:07.534576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:07.535173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:07.669228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:07.677939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fbb2393f-1eb1-4c41-b1e0-92738da5c6e8 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.159331 Aug 22 19:20:07.691831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 170/325] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:07 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:07.720065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:07.727987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3dc1ce60-4560-4a29-bcf2-6cc95948e9d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.265220 Aug 22 19:20:07.728728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 156/326] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:07 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:08.705690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:08.706297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:08.713280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:08.714601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:08.715037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:08.715799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:08.716251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:08.716673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:08.748456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:08.749056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:08.754904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:08.755382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:08.755848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:08.756538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:08.756985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:08.757400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:08.863403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:08.894676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ce0af8bf-aafc-4653-b76d-7fbe418cbf91 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.192835 Aug 22 19:20:08.899874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 171/327] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:08 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:08.946823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:08.956352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25e9c2da-fc62-4b3e-8685-3cb02aa0d22d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.211484 Aug 22 19:20:08.956833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 157/328] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:08 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:09.917614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:09.919118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:09.925980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:09.926447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:09.926918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:09.928281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:09.928903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:09.929333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:09.977703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:09.978839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:09.986543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:09.987222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:09.987870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:09.988747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:09.989351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:09.990253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:10.132381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:10.140586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ec92f1ed-dc0c-4566-811b-f4c45f672fc0 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.227660 Aug 22 19:20:10.153083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 172/329] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:09 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:10.273539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:10.282298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6573c6e4-4eb8-41fb-beea-76cb0d530059 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.308604 Aug 22 19:20:10.283081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 158/330] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:09 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:11.167260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:11.167892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:11.176031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:11.176801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:11.177239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:11.178215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:11.179425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:11.179908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:11.310010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:11.311147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:11.326548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:11.327215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:11.327962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:11.329805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:11.330269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:11.330873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:11.373703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:11.383053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-69544290-f29e-4dd0-8c1b-5fbaad4f050e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.223973 Aug 22 19:20:11.384322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 173/331] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:11 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:11.480383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:11.492220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50fc87a7-51bf-493e-9d95-a5bcb7347953 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.186944 Aug 22 19:20:11.492856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 159/332] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:11 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:11.794402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-78e30a56-93ea-4197-a85e-6c92464c98ad req-efc41292-645a-41cc-bffe-234a3802628b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2b38de-cd5b-4f68-a492-a0caff6d2886", "name": "network-vif-plugged", "status": "completed", "tag": "4ed5711f-f822-4461-8df0-99f9a0a03eb3"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:20:11.807129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-78e30a56-93ea-4197-a85e-6c92464c98ad req-efc41292-645a-41cc-bffe-234a3802628b service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:11.807837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-78e30a56-93ea-4197-a85e-6c92464c98ad req-efc41292-645a-41cc-bffe-234a3802628b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:11.808469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-78e30a56-93ea-4197-a85e-6c92464c98ad req-efc41292-645a-41cc-bffe-234a3802628b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:11.820143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-78e30a56-93ea-4197-a85e-6c92464c98ad req-efc41292-645a-41cc-bffe-234a3802628b service nova] Creating event network-vif-plugged:4ed5711f-f822-4461-8df0-99f9a0a03eb3 for instance dc2b38de-cd5b-4f68-a492-a0caff6d2886 on hv-cinder-83538 Aug 22 19:20:11.826716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-78e30a56-93ea-4197-a85e-6c92464c98ad req-efc41292-645a-41cc-bffe-234a3802628b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039144 Aug 22 19:20:11.828319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 174/333] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:20:12.408257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:12.408862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:12.415115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:12.415591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:12.416073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:12.416865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:12.417315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:12.417732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:12.515154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:12.515953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:12.523429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:12.523983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:12.524423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:12.525136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:12.525589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:12.526012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:12.592737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:12.601118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-335e7c31-6c25-435a-8fd3-2d6b97047ee6 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.199160 Aug 22 19:20:12.602104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 160/334] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:12 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:12.665601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:12.666201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:12.668300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:12.673341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:12.673532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:12.673840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:12.674269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:12.674963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:12.675414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:12.675865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:12.682841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ee9bd0d7-e4af-4b88-8948-ea90aff531c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.173006 Aug 22 19:20:12.683694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 175/335] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:12 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:12.703695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:20:12.791996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2e818d41-9ce9-41da-9c30-a92a0e38c2c9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "DELETE /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 204 len: 0 microversion: 2.1 time: 0.129939 Aug 22 19:20:12.792566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 161/336] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:20:12 2022] DELETE /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 19:20:12.800558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:12.801167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:12.807383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:12.807904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:12.808337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:12.809017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:12.809470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:12.809893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:12.932410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:12.940364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-67d8e242-c944-4037-ae37-d2dc103d69a6 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.143694 Aug 22 19:20:12.940921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 176/337] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:12 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:13.622826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:13.623520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:13.629487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:13.629963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:13.630529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:13.631204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:13.631664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:13.632084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:13.703151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:13.703778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:13.710152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:13.710625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:13.711050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:13.711790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:13.712234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:13.712692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:13.767045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:13.774672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02cab9e6-035d-4b7e-8908-81346e6048c9 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.156988 Aug 22 19:20:13.776014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 162/338] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:13 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:13.961446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:13.961958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:13.968451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:13.968930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:13.969358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:13.970047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:13.970489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:13.970903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:14.043560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:14.051987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7fccc020-3962-46a9-b9d9-0131006359d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.352490 Aug 22 19:20:14.052677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 177/339] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:13 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:14.237779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:14.245856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e6cf8cc-c96f-4665-97f9-e0210c15d4a1 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.288385 Aug 22 19:20:14.246409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 163/340] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:13 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:14.795217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:14.795892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:14.802439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:14.802924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:14.803355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:14.804077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:14.804526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:14.804947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:14.951293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:14.960746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6ce0b9f1-928c-4f90-b758-1fae1f108072 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.169774 Aug 22 19:20:14.961481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 178/341] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:14 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:15.073943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:15.074587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:15.080674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:15.081157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:15.081596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:15.082324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:15.082779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:15.083204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:15.208877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:15.212389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:15.218801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-977f8cbc-e967-4748-8359-37df6cbae2f4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.149221 Aug 22 19:20:15.219356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 164/342] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:15 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:15.266258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:15.266992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:15.272810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:15.273278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:15.273702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:15.274435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:15.274826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:15.277125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:15.402645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:15.410687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-919e1ed6-8474-4ec7-8116-be10de43186a tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.148190 Aug 22 19:20:15.411234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 179/343] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:15 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:15.981357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:15.981989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:15.988982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:15.989459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:15.989886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:15.990572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:15.991019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:15.991434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:16.117576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:16.125169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fc965a3-89da-4bf5-80b4-a131c30d8473 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.147695 Aug 22 19:20:16.125725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 165/344] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:15 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:16.239795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:16.240341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:16.247170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:16.247674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:16.248112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:16.248806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:16.249260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:16.249685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:16.377453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:16.385555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2e8d3634-39a0-4980-b199-2750805ae841 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.149761 Aug 22 19:20:16.386114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 180/345] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:16 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:16.431872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:16.432490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:16.438411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:16.438894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:16.439329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:16.440165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:16.440623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:16.441047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:16.570971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:16.580289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0b98c6d-f624-4b55-aef7-86e50c5a0474 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.152798 Aug 22 19:20:16.581027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 166/346] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:16 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:17.144894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:17.145504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:17.147423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=85 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:17.153194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:17.153675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:17.154107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:17.154796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:17.155245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:17.155691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:17.159705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:17.281798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:17.289329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5f505a59-ef5a-4bc4-a49d-7e9be1c0e3be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.148250 Aug 22 19:20:17.289888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 181/347] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:17 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:17.406829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:17.407427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:17.413364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:17.413839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:17.414270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:17.414955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:17.415400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:17.415905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:17.542186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:17.549943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7278496e-e72a-4f39-83d3-ab0adc979399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.147019 Aug 22 19:20:17.550501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 167/348] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:17 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:17.601743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:17.602349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:17.608227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:17.608701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:17.609126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:17.609800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:17.610240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:17.610653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:17.737895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:17.746296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7408f79a-b563-4d1c-9c60-27a39b75359e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.148573 Aug 22 19:20:17.746843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 182/349] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:17 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:18.310686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:18.311303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:18.317269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:18.317754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:18.318193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:18.318885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:18.319338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:18.319797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:18.453836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:18.461515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1b35243-30a4-4539-ac7e-8bc1cc34fc9c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.155295 Aug 22 19:20:18.462071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 168/350] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:18 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:18.570072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:18.570673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:18.577641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:18.578112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:18.578511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:18.579182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:18.579623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:18.580062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:18.705942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:18.713998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-254c96d8-3481-49f1-8bbe-9b94f090022d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.147697 Aug 22 19:20:18.714562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 183/351] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:18 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:18.767349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:18.767981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:18.773770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:18.774243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:18.774670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:18.775894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:18.776338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:18.776756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:18.903199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:18.911197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-139f1ffc-e282-4947-89c7-afdf1d91ba3c tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.147610 Aug 22 19:20:18.911774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 169/352] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:18 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:19.483050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:19.483719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:19.489662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:19.490138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:19.490568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:19.491249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:19.491730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:19.492154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:19.620424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:19.627905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dffefa8c-82af-4238-bc12-50e1bbf8ea35 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1315 microversion: 2.1 time: 0.148662 Aug 22 19:20:19.628462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 184/353] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:19 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:19.735156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:19.735764 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:19.741909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:19.742451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:19.742889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:19.744400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:19.744876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:19.745306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:19.871288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:19.878833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3401222-8f21-4109-8e59-60cd8d15acb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.147512 Aug 22 19:20:19.879393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 170/354] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:19 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:19.930857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:19.932097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:19.938040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:19.938512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:19.938937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:19.939614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:19.940078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:19.940494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:20.069803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:20.079191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9394c55f-f215-4c1d-b912-0127ea9d7edb tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.152043 Aug 22 19:20:20.079785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 185/355] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:19 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:20.648536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:20.649120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:20.656037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:20.656523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:20.656966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:20.657688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:20.658146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:20.658582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:20.794048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:20.801897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a6c9b2b-09f5-42d6-8af5-34e506372fd4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1465 microversion: 2.1 time: 0.157276 Aug 22 19:20:20.802458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 171/356] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:20 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:20.849618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:20.850174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:20.857623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:20.858223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:20.858823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:20.859510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:20.859980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:20.860404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:20.887417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Going to try to terminate instance {{(pid=120639) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:20:20.899543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:20.900186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:20.906189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:20.906675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:20.907110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:20.907841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:20.908295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:20.908717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:20.987424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-43547785-5704-411a-baf8-074f36b1b284 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 204 len: 0 microversion: 2.1 time: 0.141622 Aug 22 19:20:20.989308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 186/357] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:20:20 2022] DELETE /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:20:20.999756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:21.000793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:21.007048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:21.007601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:21.008022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:21.008723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:21.009190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:21.010227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:21.065173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:21.073566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47407e14-8830-4264-91b4-ed6adaaf3516 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.178907 Aug 22 19:20:21.074216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 172/358] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:20 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:21.100827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:21.101849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:21.108316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:21.108887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:21.109426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:21.110199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:21.110899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:21.111702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:21.149123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:21.157648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-339821f0-1cea-4a77-b948-0a2479b4c4be tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.163813 Aug 22 19:20:21.158362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 187/359] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:20 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:21.246315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:21.254768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-936bbe9e-000a-4fca-8127-36f580a5d36e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.157712 Aug 22 19:20:21.255324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 173/360] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:21 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:22.094472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:22.095079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:22.101736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:22.102212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:22.102641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:22.103861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:22.104308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:22.104729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:22.178229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:22.178837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:22.185518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:22.186004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:22.186495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:22.187190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:22.187675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:22.188092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:22.235357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:22.242970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7338e3c4-0970-476c-99a9-8d732ab54813 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.152312 Aug 22 19:20:22.243542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 188/361] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:22 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:22.278632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:22.279173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:22.285799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:22.286278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:22.286716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:22.287419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:22.287990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:22.288420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:22.318968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:22.331932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a933e8a-3ca1-4675-b309-ea476973aec4 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.157416 Aug 22 19:20:22.333272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 174/362] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:22 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:22.420009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:22.428001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-46174d04-1ada-48e0-ab31-ec0f32b3c40e tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.153675 Aug 22 19:20:22.428550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 189/363] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:22 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:23.264818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:23.265419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:23.271760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:23.272247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:23.272683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:23.273740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:23.274225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:23.274641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:23.354782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:23.355464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:23.362090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:23.362659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:23.363196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:23.363999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:23.364522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:23.365019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:23.412609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:23.420956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5281183e-5068-454e-90d2-a88262b4a064 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.159961 Aug 22 19:20:23.421518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 175/364] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:23 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:23.449992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:23.450594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:23.456794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:23.457278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:23.457714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:23.458409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:23.458861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:23.459299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:23.501357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:23.509495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b6092678-9379-4723-9dfb-97d0ca8a9d05 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.159491 Aug 22 19:20:23.510068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 190/365] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:23 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:23.589656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:23.597659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b4c7d952-371b-4609-b37c-3646258c1d14 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.151722 Aug 22 19:20:23.598207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 176/366] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:23 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:24.442226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:24.442840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:24.449948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:24.450447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:24.450886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:24.451606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:24.452080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:24.452502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:24.530470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:24.531079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:24.537341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:24.537827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:24.538263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:24.538980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:24.539438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:24.539905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:24.583931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:24.591960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d58a5281-269a-40a5-a5a9-20931fabc9ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.153471 Aug 22 19:20:24.592724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 191/367] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:24 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:24.617993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:24.618596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:24.625042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:24.625523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:24.626097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:24.626622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:24.627062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:24.627475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:24.672947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:24.680620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1cc50654-f32b-4e71-8346-3005acf10198 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.154249 Aug 22 19:20:24.681184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 177/368] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:24 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:24.759294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:24.768031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-62415438-ef6c-4654-bd46-16f152fe8f7b tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.153722 Aug 22 19:20:24.768597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 192/369] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:24 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:25.612881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:25.613487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:25.620224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:25.620724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:25.621133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:25.621826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:25.622271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:25.622689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:25.701441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:25.702048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:25.708402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:25.708928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:25.709354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:25.710033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:25.710475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:25.710890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:25.756344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:25.764181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7d3e3f5-0a9c-4bdc-bf1d-b796004e666f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.155170 Aug 22 19:20:25.764746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 178/370] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:25 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:25.788839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:25.789314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:25.796069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:25.796559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:25.796992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:25.797686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:25.798138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:25.798561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:25.840004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:25.847773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fcebdd43-ef2f-4798-9d07-01f60148175c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.150018 Aug 22 19:20:25.848333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 193/371] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:25 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:25.924329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:25.933105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ed63116-4b58-41c5-bcae-7c9bc069d532 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.148218 Aug 22 19:20:25.933667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 179/372] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:25 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:26.784782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:26.785380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:26.791775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:26.792243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:26.792668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:26.793344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:26.793787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:26.794203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:26.869794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:26.870401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:26.876388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:26.876871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:26.877296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:26.877981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:26.878430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:26.878850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:26.918937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:26.926618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2eda1933-77c8-47f6-9b5e-09f256085629 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.145638 Aug 22 19:20:26.927246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 194/373] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:26 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:26.953955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:26.954561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:26.960628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:26.961107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:26.961538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:26.962227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:26.962686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:26.963093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:27.010654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:27.018508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c712c39-72dd-4fce-8ce9-5a3e91c5ee6c tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.153079 Aug 22 19:20:27.019312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 180/374] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:26 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:27.094384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:27.102760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-403f8e11-c626-41ba-8dcf-cd217516b058 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.152519 Aug 22 19:20:27.103856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 195/375] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:26 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:27.293018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a1886998-9e56-47b5-8a3e-4124164ed0e0 req-dec31523-48cc-4086-939f-b98cda1000df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811f9039-8449-4f72-9793-bf132dd4b093", "name": "network-vif-unplugged", "status": "completed", "tag": "296f73cc-ce7e-4239-b7b5-5c89f1e78d0b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:20:27.302573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a1886998-9e56-47b5-8a3e-4124164ed0e0 req-dec31523-48cc-4086-939f-b98cda1000df service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:27.303053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a1886998-9e56-47b5-8a3e-4124164ed0e0 req-dec31523-48cc-4086-939f-b98cda1000df service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:27.303498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a1886998-9e56-47b5-8a3e-4124164ed0e0 req-dec31523-48cc-4086-939f-b98cda1000df service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:27.315497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a1886998-9e56-47b5-8a3e-4124164ed0e0 req-dec31523-48cc-4086-939f-b98cda1000df service nova] Creating event network-vif-unplugged:296f73cc-ce7e-4239-b7b5-5c89f1e78d0b for instance 811f9039-8449-4f72-9793-bf132dd4b093 on hv-cinder-83538 Aug 22 19:20:27.320380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a1886998-9e56-47b5-8a3e-4124164ed0e0 req-dec31523-48cc-4086-939f-b98cda1000df service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031565 Aug 22 19:20:27.320959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 181/376] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:27.947523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:27.948153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:27.954475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:27.954947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:27.955379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:27.956090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:27.956533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:27.956946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:27.961069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:28.038803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:28.039586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:28.046166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:28.046650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:28.047081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:28.047805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:28.048261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:28.048683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:28.052721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:28.085718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:28.093778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b993bf22-1efc-4a62-a72e-2483622e6d86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.150011 Aug 22 19:20:28.094378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 196/377] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:27 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:28.124817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:28.125458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:28.131230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:28.131752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:28.132181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:28.132884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:28.133369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:28.133795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:28.180966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:28.189530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a22e0a3-f785-4f5c-9889-68e3863f66a3 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.154897 Aug 22 19:20:28.190104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 182/378] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:28 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:28.279503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:28.288095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4eeced40-f114-46cb-85d6-904f75e0f8ac tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.166753 Aug 22 19:20:28.288595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 197/379] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:28 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:29.115052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:29.115794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:29.122578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:29.123074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:29.123529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:29.124280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:29.124736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:29.125165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:29.210499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:29.211309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:29.218482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:29.218992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:29.219432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:29.220264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:29.220682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:29.221169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:29.357436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:29.367777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7ed7fc66-ee91-45df-84c2-759935fbe8c7 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.161278 Aug 22 19:20:29.368912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 198/380] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:29 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:29.374889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:29.375658 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:29.384080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:29.385601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:29.387267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:29.388402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:29.389178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:29.389608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:29.522162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:29.530286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-57dff80c-a191-4790-89ec-7bc004716c19 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1554 microversion: 2.1 time: 0.159688 Aug 22 19:20:29.530851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 199/381] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:29 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:29.538742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:29.546832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-719a99ea-b2e0-430b-954a-c3bd94555b09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.435744 Aug 22 19:20:29.547381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 183/382] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:29 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:29.847466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-f8ebfd69-ebda-4273-a217-0dfa56e7dc41 req-e8bf4a1e-e4a1-4a2a-8c16-48a572641b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811f9039-8449-4f72-9793-bf132dd4b093", "name": "network-vif-deleted", "tag": "296f73cc-ce7e-4239-b7b5-5c89f1e78d0b"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:20:29.859557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-f8ebfd69-ebda-4273-a217-0dfa56e7dc41 req-e8bf4a1e-e4a1-4a2a-8c16-48a572641b31 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:29.859557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-f8ebfd69-ebda-4273-a217-0dfa56e7dc41 req-e8bf4a1e-e4a1-4a2a-8c16-48a572641b31 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:29.859557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-f8ebfd69-ebda-4273-a217-0dfa56e7dc41 req-e8bf4a1e-e4a1-4a2a-8c16-48a572641b31 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:29.872056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-f8ebfd69-ebda-4273-a217-0dfa56e7dc41 req-e8bf4a1e-e4a1-4a2a-8c16-48a572641b31 service nova] Creating event network-vif-deleted:296f73cc-ce7e-4239-b7b5-5c89f1e78d0b for instance 811f9039-8449-4f72-9793-bf132dd4b093 on hv-cinder-83538 Aug 22 19:20:29.877292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-f8ebfd69-ebda-4273-a217-0dfa56e7dc41 req-e8bf4a1e-e4a1-4a2a-8c16-48a572641b31 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033586 Aug 22 19:20:29.878414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 200/383] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:30.390164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:30.390778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:30.396838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:30.397287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:30.398117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:30.398398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:30.398849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:30.399268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:30.526708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:30.534378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5fb0a9b3-5614-4947-b394-72d0f27b6d1e tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.147970 Aug 22 19:20:30.534947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 184/384] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:30 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:30.552670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:30.553360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:30.559261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:30.559770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:30.560202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:30.560885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:30.561331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:30.561756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:30.566800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:30.567411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:30.573300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:30.573778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:30.574219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:30.574912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:30.575371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:30.575876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:30.624541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:30.632646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-da582491-d169-4116-ba4a-043ce55a2acc tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1512 microversion: 2.1 time: 0.084669 Aug 22 19:20:30.633210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 201/385] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:30 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1512 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:30.706621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:30.714745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4fd10148-a170-4e98-a593-42377a905b8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.151641 Aug 22 19:20:30.715306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 185/386] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:30 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:31.556228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:31.556789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:31.562669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:31.563135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:31.563559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:31.564258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:31.564701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:31.565119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:31.654046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:31.654653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:31.660548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:31.661025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:31.661457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:31.662140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:31.662584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:31.663001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:31.690170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:31.698245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a1a022b9-2d34-42e4-9153-cbf3ff1a1538 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.146025 Aug 22 19:20:31.698810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 202/387] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:31 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:31.724440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:31.733091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09c5727e-eb0f-428f-bc89-a9d3731f32e9 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1512 microversion: 2.1 time: 0.083383 Aug 22 19:20:31.733800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 186/388] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:31 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1512 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:31.736233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:31.736840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:31.742629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:31.743103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:31.743531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:31.744238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:31.744679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:31.745095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:31.871309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:31.878825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-93e34baf-0007-4c75-ba0a-4e93dbf1c89b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.146343 Aug 22 19:20:31.879383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 203/389] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:31 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:32.719369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:32.719945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:32.726091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:32.726820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:32.727255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:32.728231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:32.729345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:32.729788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:32.753720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:32.754324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:32.760568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:32.761242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:32.761674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:32.762362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:32.762808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:32.763224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:32.825356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:32.833422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d0b1eb11-75c6-4a1a-be1a-eb6d99088a3f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1512 microversion: 2.1 time: 0.083503 Aug 22 19:20:32.833986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 204/390] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:32 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1512 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:32.862960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:32.870648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df29dd2f-4645-448b-b91e-d968be548f63 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.155204 Aug 22 19:20:32.871210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 187/391] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:32 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:32.899665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:32.900826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:32.906695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:32.907166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:32.907591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:32.908314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:32.908759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:32.909178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:33.034657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:33.042931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1139d297-0a2c-4522-9277-3f400a8fad22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.147125 Aug 22 19:20:33.043490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 205/392] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:32 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:33.854719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:33.855521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:33.861460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:33.861938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:33.862377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:33.863066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:33.863514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:33.863963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:33.891022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:33.891631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:33.898064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:33.898541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:33.898971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:33.899672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:33.900120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:33.900725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:33.924949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:33.933533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7e2b94d-ff7b-458c-9681-608f2bd07d48 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1512 microversion: 2.1 time: 0.083135 Aug 22 19:20:33.934098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 188/393] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:33 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1512 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:34.030944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:34.038724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-80ca9d9f-b386-43e6-a834-10a239857a79 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.151423 Aug 22 19:20:34.039281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 206/394] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:33 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:34.063157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:34.064114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:34.069942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:34.070414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:34.070843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:34.071522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:34.071996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:34.072413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:34.204013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:34.211497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b688ef4-2613-4a01-bf39-130df80b62bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.152044 Aug 22 19:20:34.212072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 189/395] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:34 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:34.953592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:34.954210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:34.960786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:34.961270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:34.961704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:34.962393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:34.962844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:34.963267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:35.024458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:35.032563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-19fbc25d-16f2-4474-855a-bb420bc8b185 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1345 microversion: 2.1 time: 0.082751 Aug 22 19:20:35.033129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 207/396] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:34 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:35.059202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:35.059874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:35.065741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:35.066219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:35.066649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:35.067370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:35.067847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:35.068275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:35.236212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:35.236818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:35.242621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:35.243126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:35.243553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:35.244279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:35.245233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:35.245650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:35.352274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:35.362259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-019fd269-1332-4e33-bebc-7faf367d86dd tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1471 microversion: 2.1 time: 0.307564 Aug 22 19:20:35.362845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 190/397] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:35 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1471 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:35.378624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:35.386270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7655d29e-9743-4992-9174-2f7e332283bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.153862 Aug 22 19:20:35.386846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 208/398] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:35 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:35.866855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-60a57d8a-bd38-4a4a-9d9c-2497c32a5a89 req-2edda265-5edb-43e6-9589-945e99f18694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2b38de-cd5b-4f68-a492-a0caff6d2886", "name": "network-vif-deleted", "tag": "4ed5711f-f822-4461-8df0-99f9a0a03eb3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:20:35.887607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-60a57d8a-bd38-4a4a-9d9c-2497c32a5a89 req-2edda265-5edb-43e6-9589-945e99f18694 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:35.888113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-60a57d8a-bd38-4a4a-9d9c-2497c32a5a89 req-2edda265-5edb-43e6-9589-945e99f18694 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:35.888748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-60a57d8a-bd38-4a4a-9d9c-2497c32a5a89 req-2edda265-5edb-43e6-9589-945e99f18694 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:35.900522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-60a57d8a-bd38-4a4a-9d9c-2497c32a5a89 req-2edda265-5edb-43e6-9589-945e99f18694 service nova] Creating event network-vif-deleted:4ed5711f-f822-4461-8df0-99f9a0a03eb3 for instance dc2b38de-cd5b-4f68-a492-a0caff6d2886 on hv-cinder-83538 Aug 22 19:20:35.906315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-60a57d8a-bd38-4a4a-9d9c-2497c32a5a89 req-2edda265-5edb-43e6-9589-945e99f18694 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043049 Aug 22 19:20:35.906909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 191/399] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:36.053854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:36.054512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:36.062580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:36.062995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:36.063435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:36.064175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:36.064797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:36.065224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:36.098828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:36.099320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:36.099785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:36.100232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lazy-loading 'fault' on Instance uuid 811f9039-8449-4f72-9793-bf132dd4b093 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:20:36.155733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942c420f56f5449fbae8b4ff780d1834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae986c6b484740a9a4629648d1b65e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:36.164721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-59156228-b23f-41a9-9b97-acfd4cec0e9f tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 200 len: 1350 microversion: 2.1 time: 0.115391 Aug 22 19:20:36.165425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 209/400] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:36 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:36.384723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:36.386452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:36.393527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:36.394007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:36.394447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:36.395149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:36.395605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:36.396063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:36.409149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:36.410365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:36.419549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:36.420170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:36.420675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:36.421537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:36.422027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:36.422457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:36.432244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:36.432808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:36.433317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:36.433958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lazy-loading 'fault' on Instance uuid dc2b38de-cd5b-4f68-a492-a0caff6d2886 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:20:36.495310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a14c36af46451884400a5b8db1702d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9f4c09721e4206869bbc0e49f9ab50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:36.517896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-033bf388-7dd3-4097-ab0d-acfdece1e66d tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 200 len: 1305 microversion: 2.1 time: 0.137778 Aug 22 19:20:36.518510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 192/401] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:36 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 1305 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:36.617018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:36.624758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-edfb2587-a2fc-4a61-998a-3b313607b9f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.221848 Aug 22 19:20:36.625378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 210/402] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:36 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:37.185630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:37.186234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:37.192447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:37.192932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:37.193366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:37.194050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:37.194506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:37.195274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:37.209993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] HTTP exception thrown: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Request method failure captured: Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 HTTP/1.1 Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9Z_ubSKahvdxgeEDOJoh9fywLq8sEHLJnspDcVF_Oh97aDkA4bA594nrP4qBgQbPx0al1TpAGnigxZl8Yt1VcYMaY1rArCrR6b1LxZ1NZHCo9r3YQYvg4JU9Ri6Y7CuKCEXWzxT6WOQTgKXGaAem4ZEig_pkEbGeUeSxFrl4HjqDTg Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: ae986c6b484740a9a4629648d1b65e51 Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:20:37.214993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ae986c6b484740a9a4629648d1b65e51"}]}] Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ae986c6b484740a9a4629648d1b65e51 Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-2071424323-project Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 942c420f56f5449fbae8b4ff780d1834 Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-2071424323-project Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.216641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '811f9039-8449-4f72-9793-bf132dd4b093'} Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:20:37.217550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.219052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.220332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Returning 404 to user: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:20:37.220332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84cc883b-9f81-4592-9c7e-1baac74c3656 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 404 len: 111 microversion: 2.1 time: 0.035217 Aug 22 19:20:37.220865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 193/403] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:37 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:20:37.332870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:37.335242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:37.341924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:37.342406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:37.342836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:37.343529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:37.344008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:37.344425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:37.358509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] HTTP exception thrown: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Request method failure captured: Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093/os-volume_attachments HTTP/1.1 Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9Z_ubSKahvdxgeEDOJoh9fywLq8sEHLJnspDcVF_Oh97aDkA4bA594nrP4qBgQbPx0al1TpAGnigxZl8Yt1VcYMaY1rArCrR6b1LxZ1NZHCo9r3YQYvg4JU9Ri6Y7CuKCEXWzxT6WOQTgKXGaAem4ZEig_pkEbGeUeSxFrl4HjqDTg Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: ae986c6b484740a9a4629648d1b65e51 Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:20:37.363736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ae986c6b484740a9a4629648d1b65e51"}]}] Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: ae986c6b484740a9a4629648d1b65e51 Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-DeleteServersTestJSON-2071424323-project Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 942c420f56f5449fbae8b4ff780d1834 Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-DeleteServersTestJSON-2071424323-project Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.364994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': '811f9039-8449-4f72-9793-bf132dd4b093'} Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:20:37.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:37.366800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.367945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Returning 404 to user: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:20:37.367945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-585ebb3f-5e2f-419a-8b38-87eb609580f5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036233 Aug 22 19:20:37.367945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 211/404] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:20:37 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:20:37.544159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:37.545356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] [instance: dc2b38de-cd5b-4f68-a492-a0caff6d2886] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:37.551521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:37.552090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:37.552524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:37.553254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:37.553776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:37.554261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:37.568725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] HTTP exception thrown: Instance dc2b38de-cd5b-4f68-a492-a0caff6d2886 could not be found. Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Request method failure captured: Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 HTTP/1.1 Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9bKy3RLvrmrG8Za7X0qGACIhxU5RD7JinP_1NM4rduKDNN5gas1pNoisCnB-H2yZpOTaG1K1FVRttRkxlw3QCaNM6PLNaxUFdJYS1IpQ6S6-9tTYGtgYnNhlzUVQpPIHVujEN3QRk1N_oK8cnve4RHvM_lYPEcFDHZFU3qMnWd9iWc Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 1e9f4c09721e4206869bbc0e49f9ab50 Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-1867299081 Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:20:37.570069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e9f4c09721e4206869bbc0e49f9ab50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e9f4c09721e4206869bbc0e49f9ab50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e9f4c09721e4206869bbc0e49f9ab50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e9f4c09721e4206869bbc0e49f9ab50"}]}] Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-1867299081 Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 1e9f4c09721e4206869bbc0e49f9ab50 Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-1867299081 Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-1867299081-project Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 01a14c36af46451884400a5b8db1702d Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-1867299081-project Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance dc2b38de-cd5b-4f68-a492-a0caff6d2886 could not be found. Aug 22 19:20:37.571365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': 'dc2b38de-cd5b-4f68-a492-a0caff6d2886'} Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2b38de-cd5b-4f68-a492-a0caff6d2886 could not be found. Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:20:37.572270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2b38de-cd5b-4f68-a492-a0caff6d2886 could not be found. Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2b38de-cd5b-4f68-a492-a0caff6d2886 could not be found. Aug 22 19:20:37.573610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:37.574771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] Returning 404 to user: Instance dc2b38de-cd5b-4f68-a492-a0caff6d2886 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:20:37.574771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88a9765f-3b08-4c0c-ac8a-7d9b74abd843 tempest-VolumesNegativeTest-1867299081 tempest-VolumesNegativeTest-1867299081-project] 10.222.0.61 "GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886" status: 404 len: 111 microversion: 2.1 time: 0.032111 Aug 22 19:20:37.574771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 194/405] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:37 2022] GET /compute/v2.1/servers/dc2b38de-cd5b-4f68-a492-a0caff6d2886 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:20:37.652374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:37.653235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:37.665882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:37.666592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:37.667232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:37.668937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:37.669548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:37.669966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:37.816599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:37.824413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-608cb3c5-2cfc-4203-bd15-91ed78a05771 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.182698 Aug 22 19:20:37.824966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 212/406] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:37 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:38.590942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:38.591598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:38.597766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:38.598256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:38.598717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:38.600040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:38.600493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:38.600915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:38.615156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] HTTP exception thrown: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Request method failure captured: Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 HTTP/1.1 Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9Z_ubSKahvdxgeEDOJoh9fywLq8sEHLJnspDcVF_Oh97aDkA4bA594nrP4qBgQbPx0al1TpAGnigxZl8Yt1VcYMaY1rArCrR6b1LxZ1NZHCo9r3YQYvg4JU9Ri6Y7CuKCEXWzxT6WOQTgKXGaAem4ZEig_pkEbGeUeSxFrl4HjqDTg Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: ae986c6b484740a9a4629648d1b65e51 Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:20:38.616737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ae986c6b484740a9a4629648d1b65e51"}]}] Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ae986c6b484740a9a4629648d1b65e51 Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-2071424323-project Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 942c420f56f5449fbae8b4ff780d1834 Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-2071424323-project Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.618147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '811f9039-8449-4f72-9793-bf132dd4b093'} Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:20:38.618890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.620243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.622197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Returning 404 to user: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:20:38.622197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af995508-20d7-4439-91ae-bec0183be7a5 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "DELETE /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 404 len: 111 microversion: 2.1 time: 0.031392 Aug 22 19:20:38.622197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 195/407] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:20:38 2022] DELETE /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:20:38.627163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:38.627974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] [instance: 811f9039-8449-4f72-9793-bf132dd4b093] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:38.634222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:38.634709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:38.635149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:38.635885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:38.636338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:38.636785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:38.650971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] HTTP exception thrown: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Request method failure captured: Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 HTTP/1.1 Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9Z_ubSKahvdxgeEDOJoh9fywLq8sEHLJnspDcVF_Oh97aDkA4bA594nrP4qBgQbPx0al1TpAGnigxZl8Yt1VcYMaY1rArCrR6b1LxZ1NZHCo9r3YQYvg4JU9Ri6Y7CuKCEXWzxT6WOQTgKXGaAem4ZEig_pkEbGeUeSxFrl4HjqDTg Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: ae986c6b484740a9a4629648d1b65e51 Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:20:38.653701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ae986c6b484740a9a4629648d1b65e51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ae986c6b484740a9a4629648d1b65e51"}]}] Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: ae986c6b484740a9a4629648d1b65e51 Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-DeleteServersTestJSON-2071424323 Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-DeleteServersTestJSON-2071424323-project Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 942c420f56f5449fbae8b4ff780d1834 Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-DeleteServersTestJSON-2071424323-project Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.655182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '811f9039-8449-4f72-9793-bf132dd4b093'} Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:20:38.655882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. Aug 22 19:20:38.656951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:38.657905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] Returning 404 to user: Instance 811f9039-8449-4f72-9793-bf132dd4b093 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:20:38.657905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ab1dd2c8-8ae4-4077-b214-850e82c18a88 tempest-DeleteServersTestJSON-2071424323 tempest-DeleteServersTestJSON-2071424323-project] 10.222.0.61 "GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093" status: 404 len: 111 microversion: 2.1 time: 0.032176 Aug 22 19:20:38.657905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 213/408] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:38 2022] GET /compute/v2.1/servers/811f9039-8449-4f72-9793-bf132dd4b093 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:20:38.846520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:38.847353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:38.853781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:38.854509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:38.855142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:38.856844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:38.857307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:38.857741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:39.190550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:39.198717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4554a90d-9ca8-4251-9a19-d280f57b8987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.356926 Aug 22 19:20:39.199819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 196/409] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:38 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:40.220196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:40.220805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:40.227463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:40.227981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:40.228416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:40.229695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:40.230371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:40.231147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:40.249885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:40.387324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:40.395268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6b202f80-d24b-4e4a-91b5-b376b9f08b92 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.178819 Aug 22 19:20:40.395863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 214/410] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:40 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:41.417121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:41.417736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:41.423849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:41.424334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:41.424820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:41.425459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:41.425911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:41.426337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:41.568256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:41.576865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8917117-a781-4d5a-9dcc-9f3f5c7bdba4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.163610 Aug 22 19:20:41.577623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 197/411] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:41 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:42.600929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:42.601818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:42.608786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:42.609501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:42.610103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:42.610990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:42.611747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:42.612179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:42.748396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:42.761199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-58b2efb5-6992-44e3-a9ba-b60c66e19c2a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.164179 Aug 22 19:20:42.775573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 215/412] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:42 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:43.421135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec698796-9ed1-49a3-ab2e-cad6f0e69f4f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Action: 'create', calling method: .version_select at 0x7f66e415f700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1517553251"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:20:43.701899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec698796-9ed1-49a3-ab2e-cad6f0e69f4f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.394987 Aug 22 19:20:43.702525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 198/413] 10.222.0.61 () {60 vars in 1155 bytes} [Mon Aug 22 19:20:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 22 19:20:43.714402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6338a473-3b36-4707-8b7e-362a980a69b0 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e40f28b0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:43.762226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6338a473-3b36-4707-8b7e-362a980a69b0 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2" status: 200 len: 345 microversion: 2.1 time: 0.050912 Aug 22 19:20:43.762829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 216/414] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:20:43 2022] GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:43.782930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:43.783600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:43.785823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:43.792457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:43.793000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:43.793541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:43.794279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:43.794962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:43.795484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:43.927357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:43.935521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5fd68f1-cc82-4b37-8689-f8fa93863b36 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.156599 Aug 22 19:20:43.936105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 199/415] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:43 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:44.777538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cebe5042-dbbd-47f5-82c4-c70bdc26cd49 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e41eeee0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:44.822239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cebe5042-dbbd-47f5-82c4-c70bdc26cd49 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2" status: 200 len: 345 microversion: 2.1 time: 0.048907 Aug 22 19:20:44.822787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 217/416] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:20:44 2022] GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:44.956341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:44.956978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:44.962856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:44.963335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:44.963817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:44.964503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:44.964951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:44.965376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:45.095001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:45.102854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5d6ce04b-3af0-420a-9830-392d032d7d13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.150366 Aug 22 19:20:45.103417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 200/417] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:44 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:45.836944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-29eae921-f603-4c79-b908-4288192115c1 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e44aaca0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:45.882743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-29eae921-f603-4c79-b908-4288192115c1 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2" status: 200 len: 345 microversion: 2.1 time: 0.050122 Aug 22 19:20:45.883291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 218/418] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:20:45 2022] GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:46.123816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:46.124460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:46.130436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:46.130912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:46.131348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:46.132070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:46.132544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:46.132945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:46.258146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:46.266287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f736339a-7b6f-4fee-9a83-c16136efadb9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.146804 Aug 22 19:20:46.266844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 201/419] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:46 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:46.896965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e1bc87fc-2999-481b-83ec-02ac87bfbf9d tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e41eeee0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:46.946033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e1bc87fc-2999-481b-83ec-02ac87bfbf9d tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2" status: 200 len: 346 microversion: 2.1 time: 0.053315 Aug 22 19:20:46.946588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 219/420] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:20:46 2022] GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:46.959566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9fd9b5a3-fada-4b37-ba9e-b6b5219b0e30 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Action: 'create', calling method: .version_select at 0x7f66e415f820>, body: {"snapshot": {"volume_id": "25f9ec46-888a-41ac-b517-277b7462afa2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1408197470"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:20:47.127238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9fd9b5a3-fada-4b37-ba9e-b6b5219b0e30 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.171584 Aug 22 19:20:47.128196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 202/421] 10.222.0.61 () {60 vars in 1162 bytes} [Mon Aug 22 19:20:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:20:47.140821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b00f910-bb75-4e92-91f4-19f59179492d tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e41ee4c0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:47.184644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b00f910-bb75-4e92-91f4-19f59179492d tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 200 len: 287 microversion: 2.1 time: 0.049683 Aug 22 19:20:47.185746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 220/422] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Aug 22 19:20:47 2022] GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:47.198108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f801f728-39b3-4041-ab85-ad8f945f72bd tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e416cf70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:47.232479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f801f728-39b3-4041-ab85-ad8f945f72bd tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039483 Aug 22 19:20:47.233280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 203/423] 10.222.0.61 () {58 vars in 1140 bytes} [Mon Aug 22 19:20:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:47.244218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1d98fba1-38ba-44a0-b8e3-effc21ac69b3 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e40f2d30>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:47.286394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:47.287006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:47.287418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1d98fba1-38ba-44a0-b8e3-effc21ac69b3 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 200 len: 287 microversion: 2.1 time: 0.046975 Aug 22 19:20:47.288091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 221/424] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Aug 22 19:20:47 2022] GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:47.296172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:47.296832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:47.297529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:47.298915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:47.299683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:47.300109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:47.304691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:47.446479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:47.455131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f04e4c51-3aea-4095-8d55-45fdb356ff23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.172687 Aug 22 19:20:47.455720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 204/425] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:47 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:20:48.300402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d7f1c898-dbca-4ea9-abdd-cbb7d64396a7 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e41ee430>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:48.330444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d7f1c898-dbca-4ea9-abdd-cbb7d64396a7 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 200 len: 287 microversion: 2.1 time: 0.034277 Aug 22 19:20:48.331060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 222/426] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Aug 22 19:20:48 2022] GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:48.476394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:48.477199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:48.487543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:48.488050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:48.488477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:48.489168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:48.489610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:48.490024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:48.627361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:48.635217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53c6f801-e511-479f-8e50-95c68d96dc8f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.163650 Aug 22 19:20:48.635808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 205/427] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:48 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:49.343014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c35e8c57-0e50-41b1-becc-cc3420558e98 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e40f2e50>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:49.371725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c35e8c57-0e50-41b1-becc-cc3420558e98 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 200 len: 287 microversion: 2.1 time: 0.033362 Aug 22 19:20:49.372277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 223/428] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Aug 22 19:20:49 2022] GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:49.657036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:49.657647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:49.663525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:49.664035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:49.664467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:49.665154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:49.665605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:49.666023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:49.790977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:49.798943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac77f991-c802-4a1d-97be-7c7e41de33b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.145907 Aug 22 19:20:49.799509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 206/429] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:49 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:50.384798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-136f8e19-056d-4673-b238-817a6c60d04d tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e40fd0d0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:50.413061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-136f8e19-056d-4673-b238-817a6c60d04d tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 200 len: 287 microversion: 2.1 time: 0.032493 Aug 22 19:20:50.413659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 224/430] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Aug 22 19:20:50 2022] GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:50.821239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:50.822109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:50.829683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:50.830165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:50.830863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:50.831548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:50.832017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:50.832434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:50.961763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:50.969836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3fe2e853-5cae-4fcd-8e5b-58cc5ce538f7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.152327 Aug 22 19:20:50.970324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 207/431] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:50 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:51.426164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e605506-f7de-4c30-aa52-0f53641933db tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e40f2550>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:51.455302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2e605506-f7de-4c30-aa52-0f53641933db tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 200 len: 287 microversion: 2.1 time: 0.033268 Aug 22 19:20:51.455881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 225/432] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Aug 22 19:20:51 2022] GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:51.991203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:51.991851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:51.998411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:51.998896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:51.999331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:52.000055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:52.000509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:52.000936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:52.129555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:52.137626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d47055c9-838f-4348-ae17-e21900fe9b68 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.150318 Aug 22 19:20:52.138183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 208/433] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:51 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:52.468546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9bd841ad-ec89-4281-a2a2-a5268099af3f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e41ee5e0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:52.500829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9bd841ad-ec89-4281-a2a2-a5268099af3f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 200 len: 288 microversion: 2.1 time: 0.037091 Aug 22 19:20:52.501380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 226/434] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Aug 22 19:20:52 2022] GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:52.512532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-646d42fb-1378-4a3a-98bc-39c2594f71e2 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e416caf0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:52.567461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-646d42fb-1378-4a3a-98bc-39c2594f71e2 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 202 len: 0 microversion: 2.1 time: 0.059073 Aug 22 19:20:52.568060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 209/435] 10.222.0.61 () {58 vars in 1254 bytes} [Mon Aug 22 19:20:52 2022] DELETE /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 19:20:52.576674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-83230ad0-0db2-4714-b8da-e5b1168bb568 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e40fd3a0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:52.608278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-83230ad0-0db2-4714-b8da-e5b1168bb568 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 200 len: 287 microversion: 2.1 time: 0.035774 Aug 22 19:20:52.609012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 227/436] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Aug 22 19:20:52 2022] GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:53.158040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:53.158646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:53.164618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:53.165099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:53.165540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:53.166222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:53.166673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:53.167092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:53.296945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:53.304550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0cd4f9df-1d1b-4d32-8245-72d007ff5d49 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.150363 Aug 22 19:20:53.305103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 210/437] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:53 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:53.617792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:53.618547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=8 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:20:53.623577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-26f097dd-ed88-479b-831f-1a9d4dfd107f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e40f23a0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:53.647444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-26f097dd-ed88-479b-831f-1a9d4dfd107f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] HTTP exception thrown: Snapshot d0d58ad2-9247-4640-977e-3f8f6bf2e808 could not be found. Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-26f097dd-ed88-479b-831f-1a9d4dfd107f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Request method failure captured: Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 HTTP/1.1 Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9cLasPVNXqUEDKdJCmHLvhCVmAUHpe02gjVAQJ2f6qAsx4B4zsqpmwpuaq-sbmH7q5Po0I5kOTN9IdzIvKHWxsN4DNNVkWAoizn4oSmUKmuvJZxeFhqZvYVTqMiMgofKpSlEexNhMauXvUCBzWklvfjxgrORHWqQLBI4FKpmgQovKE Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 19936226466c4cb2869ffbc8e2157825 Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:20:53.650652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_19936226466c4cb2869ffbc8e2157825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/19936226466c4cb2869ffbc8e2157825"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/19936226466c4cb2869ffbc8e2157825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/19936226466c4cb2869ffbc8e2157825"}]}] Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 19936226466c4cb2869ffbc8e2157825 Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesSnapshotsTestJSON-5914357-project Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 4bb5d58c1c2c47d789486609992a77f5 Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesSnapshotsTestJSON-5914357-project Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Snapshot d0d58ad2-9247-4640-977e-3f8f6bf2e808 could not be found. Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': 'd0d58ad2-9247-4640-977e-3f8f6bf2e808'} Aug 22 19:20:53.652624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d0d58ad2-9247-4640-977e-3f8f6bf2e808 could not be found. (HTTP 404) (Request-ID: req-c009f025-27a4-4101-b45c-bc3d3c1ad3a8) Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:53.653527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:20:53.654882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d0d58ad2-9247-4640-977e-3f8f6bf2e808 could not be found. Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 22 19:20:53.656392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d0d58ad2-9247-4640-977e-3f8f6bf2e808 could not be found. Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d0d58ad2-9247-4640-977e-3f8f6bf2e808 could not be found. Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-26f097dd-ed88-479b-831f-1a9d4dfd107f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Returning 404 to user: Snapshot d0d58ad2-9247-4640-977e-3f8f6bf2e808 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-26f097dd-ed88-479b-831f-1a9d4dfd107f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808" status: 404 len: 111 microversion: 2.1 time: 0.035000 Aug 22 19:20:53.657891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 228/438] 10.222.0.61 () {58 vars in 1251 bytes} [Mon Aug 22 19:20:53 2022] GET /compute/v2.1/os-snapshots/d0d58ad2-9247-4640-977e-3f8f6bf2e808 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:20:53.661498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9636bb4-22d8-43c1-ac0f-73857f5cc3d3 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e416c700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:53.719449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9636bb4-22d8-43c1-ac0f-73857f5cc3d3 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2" status: 202 len: 0 microversion: 2.1 time: 0.061996 Aug 22 19:20:53.720061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 211/439] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:20:53 2022] DELETE /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:20:53.728328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8a6a3382-ccf1-4322-bf8c-526e51d8bfc7 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e405a0d0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:53.775548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8a6a3382-ccf1-4322-bf8c-526e51d8bfc7 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2" status: 200 len: 345 microversion: 2.1 time: 0.051244 Aug 22 19:20:53.776151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 229/440] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:20:53 2022] GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:20:54.326422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:54.327031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:54.333546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:54.334070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:54.334533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:54.335486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:54.335863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:54.336332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:54.512429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:54.525450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6bed8c2-c02f-4cd4-8773-09c7fa069633 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.203839 Aug 22 19:20:54.526204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 212/441] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:54 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:54.790254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-01dd3a98-4afe-4ac2-a815-1eda54f9bf81 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e40f2940>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:54.817808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-01dd3a98-4afe-4ac2-a815-1eda54f9bf81 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] HTTP exception thrown: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-01dd3a98-4afe-4ac2-a815-1eda54f9bf81 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Request method failure captured: Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 HTTP/1.1 Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9cLasPVNXqUEDKdJCmHLvhCVmAUHpe02gjVAQJ2f6qAsx4B4zsqpmwpuaq-sbmH7q5Po0I5kOTN9IdzIvKHWxsN4DNNVkWAoizn4oSmUKmuvJZxeFhqZvYVTqMiMgofKpSlEexNhMauXvUCBzWklvfjxgrORHWqQLBI4FKpmgQovKE Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 19936226466c4cb2869ffbc8e2157825 Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:20:54.820140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_19936226466c4cb2869ffbc8e2157825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/19936226466c4cb2869ffbc8e2157825"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/19936226466c4cb2869ffbc8e2157825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/19936226466c4cb2869ffbc8e2157825"}]}] Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 19936226466c4cb2869ffbc8e2157825 Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesSnapshotsTestJSON-5914357-project Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 4bb5d58c1c2c47d789486609992a77f5 Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesSnapshotsTestJSON-5914357-project Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '25f9ec46-888a-41ac-b517-277b7462afa2'} Aug 22 19:20:54.821508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. (HTTP 404) (Request-ID: req-aecdd9a5-d509-464b-ba3c-324f8f27dbb7) Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:54.822358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:20:54.823437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 19:20:54.825786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-01dd3a98-4afe-4ac2-a815-1eda54f9bf81 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Returning 404 to user: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-01dd3a98-4afe-4ac2-a815-1eda54f9bf81 tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2" status: 404 len: 109 microversion: 2.1 time: 0.035993 Aug 22 19:20:54.827478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 230/442] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:20:54 2022] GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:20:54.836657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1307f5e-5fdd-476e-8c69-bcfb7d09b11f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e416f040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:54.866815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-e1307f5e-5fdd-476e-8c69-bcfb7d09b11f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] HTTP exception thrown: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1307f5e-5fdd-476e-8c69-bcfb7d09b11f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Request method failure captured: Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 HTTP/1.1 Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9cLasPVNXqUEDKdJCmHLvhCVmAUHpe02gjVAQJ2f6qAsx4B4zsqpmwpuaq-sbmH7q5Po0I5kOTN9IdzIvKHWxsN4DNNVkWAoizn4oSmUKmuvJZxeFhqZvYVTqMiMgofKpSlEexNhMauXvUCBzWklvfjxgrORHWqQLBI4FKpmgQovKE Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 19936226466c4cb2869ffbc8e2157825 Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:20:54.871510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_19936226466c4cb2869ffbc8e2157825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/19936226466c4cb2869ffbc8e2157825"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/19936226466c4cb2869ffbc8e2157825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/19936226466c4cb2869ffbc8e2157825"}]}] Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 19936226466c4cb2869ffbc8e2157825 Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesSnapshotsTestJSON-5914357-project Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 4bb5d58c1c2c47d789486609992a77f5 Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesSnapshotsTestJSON-5914357-project Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '25f9ec46-888a-41ac-b517-277b7462afa2'} Aug 22 19:20:54.872866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. (HTTP 404) (Request-ID: req-2620bb98-67d8-4d33-86dc-8030195b0b5f) Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:54.876640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 19:20:54.878287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 19:20:54.879706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1307f5e-5fdd-476e-8c69-bcfb7d09b11f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Returning 404 to user: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1307f5e-5fdd-476e-8c69-bcfb7d09b11f tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2" status: 404 len: 109 microversion: 2.1 time: 0.039967 Aug 22 19:20:54.881005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 213/443] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:20:54 2022] DELETE /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:20:54.886910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-97fb1939-7c71-4a16-abc5-917a64b4d99c tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Calling method '.version_select at 0x7f66e405a940>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:54.915840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-97fb1939-7c71-4a16-abc5-917a64b4d99c tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] HTTP exception thrown: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-97fb1939-7c71-4a16-abc5-917a64b4d99c tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Request method failure captured: Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 HTTP/1.1 Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9cLasPVNXqUEDKdJCmHLvhCVmAUHpe02gjVAQJ2f6qAsx4B4zsqpmwpuaq-sbmH7q5Po0I5kOTN9IdzIvKHWxsN4DNNVkWAoizn4oSmUKmuvJZxeFhqZvYVTqMiMgofKpSlEexNhMauXvUCBzWklvfjxgrORHWqQLBI4FKpmgQovKE Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 19936226466c4cb2869ffbc8e2157825 Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:20:54.918377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_19936226466c4cb2869ffbc8e2157825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/19936226466c4cb2869ffbc8e2157825"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/19936226466c4cb2869ffbc8e2157825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/19936226466c4cb2869ffbc8e2157825"}]}] Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 19936226466c4cb2869ffbc8e2157825 Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-5914357 Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesSnapshotsTestJSON-5914357-project Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 4bb5d58c1c2c47d789486609992a77f5 Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesSnapshotsTestJSON-5914357-project Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '25f9ec46-888a-41ac-b517-277b7462afa2'} Aug 22 19:20:54.919886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. (HTTP 404) (Request-ID: req-10bc882f-1a63-4d46-9fda-941eea4483e9) Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:54.920923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:20:54.922509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 19:20:54.924185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-97fb1939-7c71-4a16-abc5-917a64b4d99c tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] Returning 404 to user: Volume 25f9ec46-888a-41ac-b517-277b7462afa2 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-97fb1939-7c71-4a16-abc5-917a64b4d99c tempest-VolumesSnapshotsTestJSON-5914357 tempest-VolumesSnapshotsTestJSON-5914357-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2" status: 404 len: 109 microversion: 2.1 time: 0.036655 Aug 22 19:20:54.925610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 231/444] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:20:54 2022] GET /compute/v2.1/os-volumes/25f9ec46-888a-41ac-b517-277b7462afa2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:20:55.549019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:55.549701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:55.556814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:55.557283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:55.557725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:55.558474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:55.558931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:55.559358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:55.700398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:55.708771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1d02022-2f0b-4c15-a081-ecf1f1dad1e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.164350 Aug 22 19:20:55.709335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 214/445] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:55 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:56.732047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:56.732715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:56.738706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:56.739187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:56.739621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:56.740333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:56.740831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:56.741256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:56.874514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:56.882069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d5a2a4f4-beb8-41d1-8925-45cb60780905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.155459 Aug 22 19:20:56.882618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 232/446] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:56 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:57.902507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:57.903112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:57.909302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:57.909781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:57.910209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:57.910897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:57.911342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:57.911786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:58.089196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:58.097571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5829f94-85d7-4260-a2e0-36aef16af505 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.198822 Aug 22 19:20:58.098520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 215/447] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:57 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:20:59.118063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:20:59.118722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:20:59.126123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:59.126603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:59.127030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:59.127741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:20:59.128185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:20:59.128611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:20:59.266901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:20:59.276249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ab83cffa-0875-4e97-9c0d-f556ca5161d0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.161878 Aug 22 19:20:59.276826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 233/448] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:20:59 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:00.299290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:00.300118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:00.306176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:00.306714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:00.307404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:00.309002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:00.310134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:00.310971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:00.487797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:00.496294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a26ae85-cb1f-4145-8308-0c5d5e8cf528 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1521 microversion: 2.1 time: 0.201150 Aug 22 19:21:00.499687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 216/449] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:00 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:01.520508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:01.521122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:01.529462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:01.530235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:01.530892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:01.533530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:01.534200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:01.534605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:01.703149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:01.711231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0403ef86-2121-4405-9ae2-d58b22cf6037 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1501 microversion: 2.1 time: 0.196919 Aug 22 19:21:01.719691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 234/450] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:01 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1501 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:01.732378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:01.733559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:01.740650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:01.741348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:01.741941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:01.742830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:01.743278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:01.743879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:01.923899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:01.932387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-159219fb-5542-4671-926e-13558be60aa7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1516 microversion: 2.1 time: 0.203974 Aug 22 19:21:01.932950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 217/451] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:01 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1516 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:04.456433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:21:04.460561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:04.472197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:04.473072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:04.473770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:04.474803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:04.475493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:04.476214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:04.512022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'flavor' on Instance uuid 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:21:04.615197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e058376d-1b0f-4b7c-818e-613640704428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b/action" status: 200 len: 32 microversion: 2.1 time: 0.162962 Aug 22 19:21:04.621293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 235/452] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:21:04 2022] POST /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 19:21:04.632869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:04.633382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:04.645239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:04.650315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:04.652890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:04.654201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:04.657183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:04.659636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:05.066832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:05.075068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3dcf82a8-bccb-4d02-b7c2-0e3488c9b22e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.448616 Aug 22 19:21:05.075729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 218/453] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:04 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:06.096918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:06.097717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:06.104663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:06.106241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:06.107126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:06.108217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:06.109107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:06.110143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:06.266317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:06.274792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ae279ed8-5be6-4134-960d-4497d63fd19c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.182385 Aug 22 19:21:06.275539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 236/454] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:06 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:07.297436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:07.299317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:07.306302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:07.307142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:07.307833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:07.308779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:07.309427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:07.309946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:07.549751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:07.559311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdfcd6de-8f6f-43a8-92ca-336a41babff9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.266699 Aug 22 19:21:07.573048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 219/455] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:07 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:08.579940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:08.580552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:08.587962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:08.588532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:08.588996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:08.589803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:08.590309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:08.590738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:08.736907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:08.745214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-81dc3a74-4c4e-4db3-815a-8209c6be437f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.169166 Aug 22 19:21:08.746527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 237/456] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:08 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:09.770077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:09.772011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:09.781684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:09.782515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:09.783222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:09.784674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:09.785587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:09.786253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:09.974146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:09.983265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65c2b9d3-de9e-4a18-8ad4-30c490a4c30e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.219606 Aug 22 19:21:09.984624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 220/457] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:09 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:11.014543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:11.016194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:11.028755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:11.029967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:11.030848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:11.032017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:11.032710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:11.033515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:11.346675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:11.370162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3c8ca2bf-419b-433a-a4e7-1e35dae78ac8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.368798 Aug 22 19:21:11.374262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 238/458] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:11 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:12.394523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:12.395137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:12.408293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:12.409350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:12.411459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:12.416495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:12.419157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:12.420547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:12.662631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:12.675135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5652d4b8-a2bb-43ee-b0fe-fb3ea3f213a2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.284447 Aug 22 19:21:12.676405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 221/459] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:12 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:13.697744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:13.698935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:13.705228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:13.705724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:13.706367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:13.707246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:13.708309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:13.709037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:13.873175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:13.887242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15a78fb6-eb97-4a05-9ec9-6edbcb213a34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.194704 Aug 22 19:21:13.900430 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5d37a42a-f3fb-471c-b595-664be19a5f64 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Action: 'create', calling method: .version_select at 0x7f66e4079af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1088163142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJvZSeyHEii4S76XHf/csOtxaHsyhJqIkgCWzddfoVLika9mhVxlxQkhEzkqVh3rMsJfUUpKptSPLhwzBVXDeI8/UMuPjOc5RgNzzaE/cVBztng8qGDlKiPZWg5hrKmJw=="}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:21:13.912294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 222/460] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:13 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:21:13.941823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-5d37a42a-f3fb-471c-b595-664be19a5f64 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Getting quotas for project e3adbe4feef048239c2020ac458e11b0. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:21:13.950048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-5d37a42a-f3fb-471c-b595-664be19a5f64 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Getting quotas for user a1b3705aa22743c49e3ac2f37c7f2084 and project e3adbe4feef048239c2020ac458e11b0. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:21:13.996590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5d37a42a-f3fb-471c-b595-664be19a5f64 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.330601 Aug 22 19:21:13.997292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 239/461] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 19:21:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:21:14.937430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:14.938032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:14.941778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=38 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:14.946015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:14.946499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:14.946936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:14.947637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:14.948126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:14.949107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:15.137530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:15.141185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:15.149478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e92f168f-ab5a-44d8-95c3-07081662ad0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.216702 Aug 22 19:21:15.150391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 223/462] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:14 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:16.172387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:16.172997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:16.179393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:16.179898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:16.180330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:16.181019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:16.181464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:16.181883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:16.310284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:16.317801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1718e6ee-5714-447e-ae58-ec8c1f654a39 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.150382 Aug 22 19:21:16.318364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 240/463] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:16 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:17.338313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:17.338976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:17.345155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:17.345897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:17.346466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:17.347432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:17.348801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:17.349430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:17.514292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:17.523465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b22e8a9a-9abc-4eb6-812c-d008011b5fa2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.188830 Aug 22 19:21:17.524091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 224/464] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:17 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:18.545194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:18.545968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:18.553387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:18.553880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:18.554318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:18.555065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:18.555746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:18.556190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:18.694854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:18.703107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-20960349-3a56-42bd-a7df-084cc81aa645 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.162447 Aug 22 19:21:18.703687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 241/465] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:18 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:19.724182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:19.724738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:19.731437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:19.731993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:19.732413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:19.733099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:19.733545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:19.733968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:19.872993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:19.880622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9b44fb4-2825-4305-9e2d-cb384cfc9950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.160718 Aug 22 19:21:19.881186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 225/466] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:19 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:20.901753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:20.902602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:20.910501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:20.911152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:20.911879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:20.912652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:20.913186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:20.913684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:21.074284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:21.082955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d1948985-a52f-4a3c-8de9-d22e80e8ace3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.185075 Aug 22 19:21:21.083532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 242/467] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:20 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:22.105253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:22.106492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:22.113043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:22.113722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:22.114311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:22.115240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:22.115897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:22.116525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:22.298888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:22.313703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cef01e97-6dee-4679-98cf-25e742064bb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.213768 Aug 22 19:21:22.314282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 226/468] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:22 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:23.334811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:23.335411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:23.343780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:23.344497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:23.345117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:23.346307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:23.346914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:23.347341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:23.497593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:23.505857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-712dacf5-d363-46eb-9ca1-8e7cbbcc88c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.175182 Aug 22 19:21:23.506434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 243/469] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:23 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:24.526811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:24.527420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:24.533316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:24.533799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:24.534239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:24.534930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:24.535400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:24.535948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:24.662146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:24.669594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-997ace3a-8c72-4e2c-835b-ac73685de4b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.146609 Aug 22 19:21:24.670156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 227/470] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:24 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:25.690100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:25.690719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:25.692670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:25.693868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:25.700048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:25.700531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:25.700960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:25.701644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:25.702086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:25.702502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:25.705718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:25.835020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:25.843205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-24ad6623-01ad-4859-a83b-15a6be1bd1f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.156987 Aug 22 19:21:25.843786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 244/471] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:25 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:26.864631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:26.865234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:26.871062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:26.871541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:26.872010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:26.872730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:26.873175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:26.873591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:27.006827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:27.015049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38709a87-0178-4b1f-8669-3abf6143f03d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.154250 Aug 22 19:21:27.015690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 228/472] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:26 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:28.036110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:28.036646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:28.042928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:28.043400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:28.043862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:28.044540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:28.045515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:28.045930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:28.174674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:28.182432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6d7b240d-3928-47ca-8551-997d4d4d8481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.150169 Aug 22 19:21:28.182988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 245/473] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:28 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:29.202217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:29.202844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:29.208932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:29.209358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:29.209800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:29.210489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:29.210966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:29.211347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:29.352741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:29.362576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96592a4e-8267-4b90-a6aa-7d3effc96a17 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.164114 Aug 22 19:21:29.363283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 229/474] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:29 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:30.384164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:30.385086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:30.391727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:30.392205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:30.392637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:30.393324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:30.393774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:30.394195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:30.528926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:30.536447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-79847153-b1d6-481c-902e-cc9b79d76489 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.156106 Aug 22 19:21:30.537006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 246/475] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:30 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:31.557737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:31.558348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:31.564971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:31.565450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:31.565884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:31.566578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:31.567028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:31.567449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:31.698388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:31.705922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da289cc8-e1c5-4923-b165-455c9451c142 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.152056 Aug 22 19:21:31.706475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 230/476] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:31 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:32.727070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:32.727758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:32.735195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:32.735696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:32.736124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:32.736807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:32.737251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:32.737668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:32.873795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:32.882029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6ef355d6-7fb5-4e61-aa68-da31c0ac1f3f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.159502 Aug 22 19:21:32.882594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 247/477] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:32 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:33.904069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:33.906977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:33.913058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:33.913648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:33.914151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:33.914997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:33.915513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:33.916017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:34.063970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:34.072105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73315336-5811-414c-95e6-58829fab3430 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1502 microversion: 2.1 time: 0.171986 Aug 22 19:21:34.072678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 231/478] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:33 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:34.094529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ff6a380-9900-4a2d-9d63-021a482f9c1f"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:21:34.096993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:34.103770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:34.104258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:34.104691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:34.105395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:34.105844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:34.106264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:34.133705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Cannot 'attach_volume' instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b while it is in vm_state rescued Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: POST /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b/os-volume_attachments HTTP/1.1 Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 74 Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:21:34.135439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {"volumeAttachment": {"volumeId": "1ff6a380-9900-4a2d-9d63-021a482f9c1f"}} Aug 22 19:21:34.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Cannot 'attach_volume' instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b while it is in vm_state rescued Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': '6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b', 'body': {'volumeAttachment': {'volumeId': '1ff6a380-9900-4a2d-9d63-021a482f9c1f'}}} Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:21:34.138111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b while it is in vm_state rescued Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:21:34.140292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:21:34.148003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:21:34.148003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:21:34.148003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b while it is in vm_state rescued Aug 22 19:21:34.148003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:21:34.148003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 409 to user: Cannot 'attach_volume' instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b while it is in vm_state rescued {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:21:34.148003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cc0b0f27-834b-4d1f-8e31-4fa0a7450a9e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046684 Aug 22 19:21:34.148003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 248/479] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Aug 22 19:21:34 2022] POST /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 22 19:21:34.148985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f6d82e6-9a5a-4911-b08f-d3b56639f59f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:21:34.148985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f6d82e6-9a5a-4911-b08f-d3b56639f59f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:34.154300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6d82e6-9a5a-4911-b08f-d3b56639f59f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:34.157341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6d82e6-9a5a-4911-b08f-d3b56639f59f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:34.157341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6d82e6-9a5a-4911-b08f-d3b56639f59f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:34.157341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6d82e6-9a5a-4911-b08f-d3b56639f59f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:34.157341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6d82e6-9a5a-4911-b08f-d3b56639f59f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:34.157774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f6d82e6-9a5a-4911-b08f-d3b56639f59f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:34.232268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f6d82e6-9a5a-4911-b08f-d3b56639f59f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b/action" status: 202 len: 0 microversion: 2.1 time: 0.089101 Aug 22 19:21:34.233100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 232/480] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:21:34 2022] POST /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:21:34.243755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:34.244384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:34.252055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:34.252549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:34.252992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:34.253701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:34.254983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:34.255481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:34.462053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:34.470269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5a9d8856-3c83-4c0c-a027-e4359516c1d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1510 microversion: 2.1 time: 0.231302 Aug 22 19:21:34.470975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 249/481] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:34 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:35.497874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:35.498572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:35.505465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:35.505949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:35.506381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:35.507074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:35.507528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:35.507990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:35.662969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:35.670612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08d92d25-3677-47f0-b40e-c678e06d03d9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1510 microversion: 2.1 time: 0.177001 Aug 22 19:21:35.671262 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 233/482] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:35 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:36.693572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:36.694214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:36.700634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:36.701117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:36.701554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:36.702247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:36.702700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:36.703626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:36.839800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:36.847285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dbfd4d3c-9938-4a87-a745-ee0613ea12f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1510 microversion: 2.1 time: 0.157617 Aug 22 19:21:36.847867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 250/483] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:36 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:37.868993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:37.869544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:37.875987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:37.876469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:37.876903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:37.877590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:37.878040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:37.878462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:38.011107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:38.019621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8837458e-4cc2-4825-9f5b-5bcf093c709d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1510 microversion: 2.1 time: 0.154575 Aug 22 19:21:38.020195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 234/484] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:37 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:39.040589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:39.041292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:39.047569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:39.048083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:39.048518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:39.049203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:39.049650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:39.050070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:39.183928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:39.191491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-009198eb-c83c-4f7e-9ebd-f5bd9d61b69a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1516 microversion: 2.1 time: 0.154711 Aug 22 19:21:39.192082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 251/485] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:39 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:41.598524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4eec0030-3252-4864-a817-95cb72485a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'create', calling method: .version_select at 0x7f66e415fdc0>, body: {"keypair": {"name": "tempest-keypair-1297287508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJY7M+orKyD6CAx176ORSGqorju9dJtYrxJfI9YgjuR6ioc4OYZn13CavGRgJ3hiUJc30YoEaR1p7o5FZoDw1IAHGvZOKX7pwgBcZmUmtDY4zNIgw3xJlqXkYOAmu7OfA=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:21:41.615503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-4eec0030-3252-4864-a817-95cb72485a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Getting quotas for project 0e3308fc667c4b8c8552e27ba69d40fc. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:21:41.619309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-4eec0030-3252-4864-a817-95cb72485a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Getting quotas for user 8030a8ebdd8c45c7bd30403c866a9278 and project 0e3308fc667c4b8c8552e27ba69d40fc. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:21:41.631437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4eec0030-3252-4864-a817-95cb72485a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [1bca405a-bc23-4f89-8d05-e5aaf6bb6c85] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 19:21:42.638613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [None req-4eec0030-3252-4864-a817-95cb72485a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [1bca405a-bc23-4f89-8d05-e5aaf6bb6c85] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36222. Aug 22 19:21:42.653454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4eec0030-3252-4864-a817-95cb72485a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.060953 Aug 22 19:21:42.654040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 235/486] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 19:21:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:21:43.868884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1090894418", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11651de2-775a-4c1f-bdbd-479e25707d74"}], "security_groups": [{"name": "tempest-securitygroup--1840538005"}], "key_name": "tempest-keypair-1297287508", "user_data": "}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:21:43.981180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] validate_networks() for [('11651de2-775a-4c1f-bdbd-479e25707d74', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:21:44.356360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:21:44.356827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:21:44.357420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:21:44.357842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:21:44.358274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:21:44.368250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:44.368732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:44.369164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:44.369891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:44.370370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:44.370794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:44.387539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Getting quotas for project 0e3308fc667c4b8c8552e27ba69d40fc. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:21:44.392048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Getting quotas for user 8030a8ebdd8c45c7bd30403c866a9278 and project 0e3308fc667c4b8c8552e27ba69d40fc. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:21:44.402905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:21:44.405236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:21:44.450702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR oslo.messaging._drivers.impl_rabbit [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [de3041a1-4d92-47d0-b14e-d1766a114ea9] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 19:21:45.459002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [de3041a1-4d92-47d0-b14e-d1766a114ea9] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36274. Aug 22 19:21:45.462719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-71c9b45b-00b4-4664-a5ac-45018623ff75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.598069 Aug 22 19:21:45.463560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 252/487] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:21:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:21:45.474306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-68590d6b-0bbb-49b3-b751-96b012af73c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:45.474949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-68590d6b-0bbb-49b3-b751-96b012af73c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:45.477228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:45.531196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-68590d6b-0bbb-49b3-b751-96b012af73c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:45.539003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-68590d6b-0bbb-49b3-b751-96b012af73c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1246 microversion: 2.1 time: 0.068644 Aug 22 19:21:45.539560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 236/488] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:46.560418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-92c10983-b26a-44cb-83ca-ffa53d4cc92b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:46.561197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-92c10983-b26a-44cb-83ca-ffa53d4cc92b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:46.619565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-92c10983-b26a-44cb-83ca-ffa53d4cc92b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:46.626276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-92c10983-b26a-44cb-83ca-ffa53d4cc92b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1246 microversion: 2.1 time: 0.070794 Aug 22 19:21:46.626828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 253/489] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:21:47.646667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-459537f0-c878-4952-bac0-fef1feffeb0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:47.647218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-459537f0-c878-4952-bac0-fef1feffeb0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:47.699771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-459537f0-c878-4952-bac0-fef1feffeb0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:47.707312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-459537f0-c878-4952-bac0-fef1feffeb0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1246 microversion: 2.1 time: 0.065010 Aug 22 19:21:47.708073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 237/490] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1246 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:48.727846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-da6450df-28fa-49c1-8344-50d3a9a108ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:48.728465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-da6450df-28fa-49c1-8344-50d3a9a108ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:48.783127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-da6450df-28fa-49c1-8344-50d3a9a108ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:48.791001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-da6450df-28fa-49c1-8344-50d3a9a108ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1246 microversion: 2.1 time: 0.067195 Aug 22 19:21:48.802782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 254/491] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1246 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:49.812314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:49.812903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:49.814760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:49.820119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:49.820596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:49.821031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:49.821714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:49.822159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:49.822577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:49.884217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:49.891663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-899d1a7e-d7ec-455c-b0ba-38d5888a4b71 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1250 microversion: 2.1 time: 0.083171 Aug 22 19:21:49.892235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 238/492] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:50.912563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:50.913129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:50.919595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:50.920332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:50.920759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:50.921627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:50.922068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:50.922662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:50.986051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:50.995418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c2c37d71-eb36-4c08-85b0-25fb20a80d25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1316 microversion: 2.1 time: 0.086115 Aug 22 19:21:50.996250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 255/493] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:52.018081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:52.018915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:52.025105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:52.025501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:52.025936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:52.026634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:52.027087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:52.027531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:52.236212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:52.243638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0bd79e0-d988-4aa2-ad42-2d411453fc88 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.230647 Aug 22 19:21:52.244225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 239/494] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:52.273944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-920f710e-3483-437d-832d-76f922948629 req-6fbb2b91-036d-4017-a713-312b69a6e6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6744e43-5389-4422-9030-dfdf1b522dcc", "tag": "bec8e930-d13a-4c77-9943-50527898de38"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:21:52.283991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-920f710e-3483-437d-832d-76f922948629 req-6fbb2b91-036d-4017-a713-312b69a6e6e5 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:52.284402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-920f710e-3483-437d-832d-76f922948629 req-6fbb2b91-036d-4017-a713-312b69a6e6e5 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:52.284840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-920f710e-3483-437d-832d-76f922948629 req-6fbb2b91-036d-4017-a713-312b69a6e6e5 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:52.298264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-920f710e-3483-437d-832d-76f922948629 req-6fbb2b91-036d-4017-a713-312b69a6e6e5 service nova] Creating event network-changed:bec8e930-d13a-4c77-9943-50527898de38 for instance f6744e43-5389-4422-9030-dfdf1b522dcc on hv-cinder-83538 Aug 22 19:21:52.304404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-920f710e-3483-437d-832d-76f922948629 req-6fbb2b91-036d-4017-a713-312b69a6e6e5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034354 Aug 22 19:21:52.305414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 256/495] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:21:53.265724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:53.266357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:53.272733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:53.273206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:53.273635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:53.274316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:53.274768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:53.275187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:53.406084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:53.414235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f6f5191-13dc-4a56-836a-558f8a2c8f1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.152313 Aug 22 19:21:53.414803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 240/496] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:54.432115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:54.436163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:54.436858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:54.443127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:54.443603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:54.444054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:54.444736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:54.445180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:54.445597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:54.575759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:54.590040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5451b245-3f14-48ef-adae-f5de46a7cf15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.153733 Aug 22 19:21:54.590040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 257/497] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:55.605445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:55.606062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:55.612391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:55.612872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:55.613310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:55.614001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:55.614449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:55.614869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:55.745754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:55.753240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b9473c0-68f4-4d36-860e-9d2c51a25e4a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.151616 Aug 22 19:21:55.753796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 241/498] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:56.773804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:56.774441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:56.776721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:56.781778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:56.782251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:56.782728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:56.783997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:56.784447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:56.784863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:56.788080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=62 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:56.914203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:56.921733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-34ce2ec0-1cfb-435c-be1a-9a8f4e7d914a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.151657 Aug 22 19:21:56.922286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 258/499] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:57.942343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:57.942950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:57.944810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:57.950202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:57.950683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:57.951114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:57.951848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:57.952302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:57.952726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:58.080018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:58.087431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a973c7e-88e8-44c9-8ea6-36724dd9ef25 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.149001 Aug 22 19:21:58.088025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 242/500] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:21:59.108661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:21:59.109280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:21:59.111788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=10 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:21:59.117212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:59.117702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:59.118139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:59.118843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:21:59.119299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:21:59.119790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:21:59.258834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:21:59.266598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-784ec81b-e4fb-432e-a16d-8fb9ad48c613 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.161774 Aug 22 19:21:59.267175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 259/501] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:21:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:00.288285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:00.288844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:00.294672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:00.295145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:00.295572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:00.296270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:00.296717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:00.297128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:00.429053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:00.436645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10ed3fa4-671c-473d-b9d7-669f097c8a8a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.152797 Aug 22 19:22:00.437215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 243/502] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:01.458148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:01.458778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:01.464733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:01.465216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:01.465654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:01.466345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:01.466799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:01.467226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:01.594336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:01.602637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4537d321-caa6-4787-89ce-f03f3f8d1448 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.148848 Aug 22 19:22:01.603196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 260/503] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:02.622136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:02.622871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:02.628821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:02.629303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:02.629741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:02.630431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:02.630883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:02.631309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:02.666717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-dc4bcfa2-2ec1-4cb7-b8b3-64fac42adcef req-8720c573-6bb1-46f8-9227-683cb15bc810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6744e43-5389-4422-9030-dfdf1b522dcc", "name": "network-vif-plugged", "status": "completed", "tag": "bec8e930-d13a-4c77-9943-50527898de38"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:02.678625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-dc4bcfa2-2ec1-4cb7-b8b3-64fac42adcef req-8720c573-6bb1-46f8-9227-683cb15bc810 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:02.679236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-dc4bcfa2-2ec1-4cb7-b8b3-64fac42adcef req-8720c573-6bb1-46f8-9227-683cb15bc810 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:02.680182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-dc4bcfa2-2ec1-4cb7-b8b3-64fac42adcef req-8720c573-6bb1-46f8-9227-683cb15bc810 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:02.692118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-dc4bcfa2-2ec1-4cb7-b8b3-64fac42adcef req-8720c573-6bb1-46f8-9227-683cb15bc810 service nova] Creating event network-vif-plugged:bec8e930-d13a-4c77-9943-50527898de38 for instance f6744e43-5389-4422-9030-dfdf1b522dcc on hv-cinder-83538 Aug 22 19:22:02.698124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-dc4bcfa2-2ec1-4cb7-b8b3-64fac42adcef req-8720c573-6bb1-46f8-9227-683cb15bc810 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035192 Aug 22 19:22:02.699285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 261/504] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:22:02.769072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:02.777587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9450abcd-4851-4c3c-943f-8e8f294326e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.159311 Aug 22 19:22:02.778159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 244/505] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:03.798667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:03.799366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:03.806636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:03.807119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:03.807559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:03.808305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:03.808761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:03.809186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:03.941156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:03.950892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-45317ba0-1bd9-4eb6-a7ea-7bf2b000e22c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.156772 Aug 22 19:22:03.951459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 262/506] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:04.971970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:04.972583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:04.979350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:04.979992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:04.980293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:04.980993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:04.981463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:04.981876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:05.119396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:05.126992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d958ffa8-0699-431b-8262-47f6bec7823b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1372 microversion: 2.1 time: 0.158760 Aug 22 19:22:05.127549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 245/507] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:06.147957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:06.148562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:06.155419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:06.155925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:06.156352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:06.157045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:06.157486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:06.157902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:06.288344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:06.295933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f3c7c9ea-c308-439d-8f68-22a6edc8b354 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1565 microversion: 2.1 time: 0.151901 Aug 22 19:22:06.296487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 263/508] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:06.316373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd9bc1af-a634-4e1e-be9c-205643dd1988 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:06.316889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd9bc1af-a634-4e1e-be9c-205643dd1988 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:06.322707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9bc1af-a634-4e1e-be9c-205643dd1988 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:06.323192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9bc1af-a634-4e1e-be9c-205643dd1988 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:06.323631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9bc1af-a634-4e1e-be9c-205643dd1988 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:06.324350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9bc1af-a634-4e1e-be9c-205643dd1988 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:06.324804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9bc1af-a634-4e1e-be9c-205643dd1988 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:06.325231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd9bc1af-a634-4e1e-be9c-205643dd1988 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:06.404242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd9bc1af-a634-4e1e-be9c-205643dd1988 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091603 Aug 22 19:22:06.404870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 246/509] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Aug 22 19:22:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:22:07.308211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-ecd562ec-c2be-4d05-81e0-cd01b9452be3 req-e3a45cc3-8e59-4b2f-85cf-770587023d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6744e43-5389-4422-9030-dfdf1b522dcc", "tag": "bec8e930-d13a-4c77-9943-50527898de38"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:07.319410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-ecd562ec-c2be-4d05-81e0-cd01b9452be3 req-e3a45cc3-8e59-4b2f-85cf-770587023d48 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:07.319922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-ecd562ec-c2be-4d05-81e0-cd01b9452be3 req-e3a45cc3-8e59-4b2f-85cf-770587023d48 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:07.320377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-ecd562ec-c2be-4d05-81e0-cd01b9452be3 req-e3a45cc3-8e59-4b2f-85cf-770587023d48 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:07.332754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-ecd562ec-c2be-4d05-81e0-cd01b9452be3 req-e3a45cc3-8e59-4b2f-85cf-770587023d48 service nova] Creating event network-changed:bec8e930-d13a-4c77-9943-50527898de38 for instance f6744e43-5389-4422-9030-dfdf1b522dcc on hv-cinder-83538 Aug 22 19:22:07.338380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-ecd562ec-c2be-4d05-81e0-cd01b9452be3 req-e3a45cc3-8e59-4b2f-85cf-770587023d48 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034361 Aug 22 19:22:07.339057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 264/510] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:22:10.520268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1581397582", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1088163142", "security_groups": [{"name": "tempest-secgroup-smoke-1321779920"}], "block_device_mapping_v2": [{"uuid": "73ca9bb8-d47b-486a-9fe6-3c3aae0c0cba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eb63c049-4ccb-44c0-af53-796213b87279"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:10.630946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] validate_networks() for [('eb63c049-4ccb-44c0-af53-796213b87279', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:22:10.994317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:22:10.994737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:22:10.995204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:22:10.995662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:22:10.996073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:22:11.005661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:11.006134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:11.006562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:11.007279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:11.007748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:11.008165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:11.024838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Getting quotas for project e3adbe4feef048239c2020ac458e11b0. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:22:11.028755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Getting quotas for user a1b3705aa22743c49e3ac2f37c7f2084 and project e3adbe4feef048239c2020ac458e11b0. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:22:11.091173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:22:11.093306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73ca9bb8-d47b-486a-9fe6-3c3aae0c0cba',volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:22:11.230034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ceb875a2-5382-4806-a536-f3e68a7c900c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711959 Aug 22 19:22:11.230034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 247/511] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:22:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:22:11.240335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2beb6c5f-3bb5-4d7f-a55d-e24e47459bcd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:11.241038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2beb6c5f-3bb5-4d7f-a55d-e24e47459bcd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:11.299796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2beb6c5f-3bb5-4d7f-a55d-e24e47459bcd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:11.308364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2beb6c5f-3bb5-4d7f-a55d-e24e47459bcd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1095 microversion: 2.1 time: 0.072170 Aug 22 19:22:11.309113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 265/512] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:11 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:12.330807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:12.331529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:12.339004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:12.339885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:12.340335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:12.341047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:12.341503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:12.341921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:12.429910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:12.439314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1714ac44-8fe2-4b27-98d1-3d734c2846c5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1201 microversion: 2.1 time: 0.112482 Aug 22 19:22:12.440269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 248/513] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:12 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1201 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:13.460031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:13.460643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:13.467626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:13.468378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:13.468813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:13.469506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:13.470230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:13.470529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:13.616137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:13.626628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c9f2a76d-1f29-495d-8682-5216d4541582 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1279 microversion: 2.1 time: 0.170302 Aug 22 19:22:13.627304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 266/514] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:13 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:14.647553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:14.648207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:14.654106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:14.654592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:14.655028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:14.655742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:14.656241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:14.656619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:14.849810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:14.857333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e82714b-6ca0-4d1d-bcd5-f356e00f91e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1279 microversion: 2.1 time: 0.213635 Aug 22 19:22:14.858011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 249/515] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:14 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:15.289120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-1e0a1936-a960-4636-bb1d-eef2a3c609b1 req-0de88a61-e672-44fa-9dc8-5e9acecbcd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3f25ff-3b82-4e99-8f50-4b422b2f7b59", "tag": "e7503875-9afe-45eb-baf3-3daa6a183bc6"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:15.298834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-1e0a1936-a960-4636-bb1d-eef2a3c609b1 req-0de88a61-e672-44fa-9dc8-5e9acecbcd03 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:15.299247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-1e0a1936-a960-4636-bb1d-eef2a3c609b1 req-0de88a61-e672-44fa-9dc8-5e9acecbcd03 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:15.299708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-1e0a1936-a960-4636-bb1d-eef2a3c609b1 req-0de88a61-e672-44fa-9dc8-5e9acecbcd03 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:15.310722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-1e0a1936-a960-4636-bb1d-eef2a3c609b1 req-0de88a61-e672-44fa-9dc8-5e9acecbcd03 service nova] Creating event network-changed:e7503875-9afe-45eb-baf3-3daa6a183bc6 for instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 on hv-cinder-83538 Aug 22 19:22:15.315378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-1e0a1936-a960-4636-bb1d-eef2a3c609b1 req-0de88a61-e672-44fa-9dc8-5e9acecbcd03 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030005 Aug 22 19:22:15.316164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 267/516] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:22:15.877487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:15.878098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:15.880497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:15.885525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:15.886001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:15.886435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:15.887143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:15.887598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:15.888057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:16.015462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:16.023513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6710135d-71cf-4811-ad5d-3dfc6b121ad3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1279 microversion: 2.1 time: 0.149754 Aug 22 19:22:16.024094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 250/517] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:15 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:17.044718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:17.045336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:17.052304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:17.052909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:17.053454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:17.054272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:17.054784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:17.055270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:17.189107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:17.196670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-40724b9c-9c41-4628-9014-6261a423de48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1279 microversion: 2.1 time: 0.156687 Aug 22 19:22:17.197211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 268/518] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:17 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:18.223468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:18.224907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:18.230810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:18.231372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:18.232055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:18.233162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:18.233792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:18.234442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:18.365392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:18.372974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fdcb720d-0787-45bb-b059-dc7d09dbf95f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1279 microversion: 2.1 time: 0.153317 Aug 22 19:22:18.373539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 251/519] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:18 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:19.393468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:19.394011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:19.400399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:19.400880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:19.401315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:19.402001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:19.402454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:19.402877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:19.527443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:19.534963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e2f91238-2db2-47a2-b688-4790b3e7929e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1279 microversion: 2.1 time: 0.145419 Aug 22 19:22:19.535529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 269/520] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:19 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:20.555409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:20.556005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:20.561801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:20.562286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:20.562722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:20.563415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:20.563896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:20.564326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:20.566826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=79 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:20.700174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:20.708407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31b7da9c-85f0-45f8-bd43-193d2d54f72f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1279 microversion: 2.1 time: 0.156373 Aug 22 19:22:20.708999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 252/521] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:20 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:21.169417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-699727031", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "networks": [{"uuid": "99543fa1-797d-4736-ad9c-2245f1605915"}]}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:21.221714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] validate_networks() for [('99543fa1-797d-4736-ad9c-2245f1605915', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:22:21.304706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:21.562573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:22:21.563020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:22:21.563494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:22:21.563928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:22:21.564333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:22:21.572947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:21.573419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:21.573847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:21.574562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:21.575007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:21.575424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:21.592159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Getting quotas for project 44cc7501b8ad41cc93825b4480d7c3df. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:22:21.596044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Getting quotas for user aa9a0d600b1c42ec8fbb6710744bbd1d and project 44cc7501b8ad41cc93825b4480d7c3df. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:22:21.607470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:22:21.609719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:22:21.653463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7053291c-7ded-4b19-8520-5f8a1ff7cbde tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487756 Aug 22 19:22:21.654109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 270/522] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:22:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:22:21.665557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd3e4cec-17da-450c-9391-1376e9c7875c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:21.666173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd3e4cec-17da-450c-9391-1376e9c7875c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:21.670972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:21.671825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:21.722124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd3e4cec-17da-450c-9391-1376e9c7875c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:21.730274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd3e4cec-17da-450c-9391-1376e9c7875c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1218 microversion: 2.1 time: 0.069118 Aug 22 19:22:21.730416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:21.731147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 253/523] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:21 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:21.731939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:21.738767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:21.739319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:21.739860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:21.740638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:21.741225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:21.741791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:21.877800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:21.886843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b222edee-ccef-471f-9605-ee9f8a63fbba tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1279 microversion: 2.1 time: 0.160349 Aug 22 19:22:21.887431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 271/524] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:21 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:22.751551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:22.752296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:22.758959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:22.759493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:22.759995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:22.760768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:22.761285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:22.761766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:22.838435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:22.847622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad7182a8-2779-41e4-8407-d92ed8667853 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1278 microversion: 2.1 time: 0.100600 Aug 22 19:22:22.848261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 254/525] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:22 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:22.909352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:22.910729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:22.917429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:22.917921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:22.918352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:22.919048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:22.919499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:22.919954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:23.062843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:23.076884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cb054b94-1479-4d04-b040-d405da22c17a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1279 microversion: 2.1 time: 0.172951 Aug 22 19:22:23.077476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 272/526] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:22 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:23.868047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:23.868653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:23.874781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:23.875362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:23.875951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:23.876656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:23.877173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:23.877632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:24.008051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:24.015522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0b5c9f4-0237-4bc4-9343-23c7d59f8fdd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.151354 Aug 22 19:22:24.016116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 255/527] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:23 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:24.096954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:24.097556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:24.104757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:24.105231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:24.105657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:24.106384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:24.106801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:24.107218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:24.237774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:24.245262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-812a251c-afdc-49f8-ba0c-bd152cdfef19 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.152106 Aug 22 19:22:24.245820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 273/528] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:24 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:25.037062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:25.038296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:25.044241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:25.044723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:25.045384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:25.046087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:25.046540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:25.046963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:25.267596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:25.268232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:25.274424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:25.274911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:25.275341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:25.276077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:25.276552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:25.277001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:25.331568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:25.339542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f3932fe-37b2-4d8b-b21d-15d99e740cc5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.306702 Aug 22 19:22:25.340510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 256/529] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:25 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:25.398030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-75990db5-5859-407e-9907-98a864ac1ef5 req-6d4b4200-cceb-46bd-91a4-c3b788ac5c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2704afce-f4f6-491d-b146-17ed89f2b747", "tag": "d4252c5b-98aa-47dd-a413-17ffc2a1197c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:25.407940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-75990db5-5859-407e-9907-98a864ac1ef5 req-6d4b4200-cceb-46bd-91a4-c3b788ac5c58 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:25.408666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-75990db5-5859-407e-9907-98a864ac1ef5 req-6d4b4200-cceb-46bd-91a4-c3b788ac5c58 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:25.409100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-75990db5-5859-407e-9907-98a864ac1ef5 req-6d4b4200-cceb-46bd-91a4-c3b788ac5c58 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:25.420750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-75990db5-5859-407e-9907-98a864ac1ef5 req-6d4b4200-cceb-46bd-91a4-c3b788ac5c58 service nova] Creating event network-changed:d4252c5b-98aa-47dd-a413-17ffc2a1197c for instance 2704afce-f4f6-491d-b146-17ed89f2b747 on hv-cinder-83538 Aug 22 19:22:25.425886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-75990db5-5859-407e-9907-98a864ac1ef5 req-6d4b4200-cceb-46bd-91a4-c3b788ac5c58 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033303 Aug 22 19:22:25.427601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 257/530] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:22:25.439362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:25.448097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3b97da64-ca37-4826-95e7-a4172cbe3e53 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.184834 Aug 22 19:22:25.448673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 274/531] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:25 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:26.361377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:26.362777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:26.369570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:26.370131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:26.370754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:26.371451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:26.372131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:26.372558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:26.469188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:26.469800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:26.477065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:26.477546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:26.477982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:26.478745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:26.479197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:26.479620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:26.498661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:26.506177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e06cd60e-f914-455e-a5a8-b806874dff92 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.149074 Aug 22 19:22:26.506741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 258/532] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:26 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:26.606162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:26.613734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fdd3e6e4-ae1c-4ca8-8ad2-9e9ef4f1a988 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.148400 Aug 22 19:22:26.614987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 275/533] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:26 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:27.526191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:27.526798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:27.532900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:27.533248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:27.533680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:27.534368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:27.534811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:27.535230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:27.634699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:27.635307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:27.637607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:27.642880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:27.643360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:27.643818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:27.644511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:27.644960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:27.645413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:27.650294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=86 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:27.667191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:27.674601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b4fc7886-cf76-43a9-847e-3d703a874bd5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.152235 Aug 22 19:22:27.675162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 259/534] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:27 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:27.777368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:27.785322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cea4b83e-8889-4b52-b75c-f0df9a048171 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.154365 Aug 22 19:22:27.785887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 276/535] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:27 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:28.695704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:28.696309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:28.702155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:28.702628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:28.703054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:28.703755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:28.704199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:28.704613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:28.805763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:28.806493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:28.812812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:28.813376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:28.813887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:28.814662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:28.815123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:28.815551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:28.829787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:28.837898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25fda453-d303-437b-a8ce-ce9f7fd64f72 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.146582 Aug 22 19:22:28.838458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 260/536] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:28 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:28.943301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:28.950913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8d5631fb-75fa-4c04-910c-05e4a2243345 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.148913 Aug 22 19:22:28.951418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 277/537] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:28 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:29.858955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:29.859591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:29.866058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:29.866545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:29.866976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:29.867689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:29.868141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:29.868568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:29.971971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:29.972582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:29.979306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:29.979817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:29.980252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:29.980942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:29.981393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:29.981814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:29.999067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:30.007411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ed74306-9818-40ce-b1b5-45565402c375 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.152346 Aug 22 19:22:30.008022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 261/538] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:29 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:30.115439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:30.123011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-034c3202-0a60-4ece-9463-4ca9f465619a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.154955 Aug 22 19:22:30.123560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 278/539] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:29 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:31.027136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:31.027795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:31.033766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:31.034241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:31.034673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:31.035357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:31.035886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:31.036317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:31.143507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:31.144152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:31.152000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:31.152495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:31.152934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:31.153633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:31.154088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:31.154513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:31.167174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:31.174835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e550f44-735f-4540-99c7-7d28ee0c9909 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.151590 Aug 22 19:22:31.175390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 262/540] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:31 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:31.282748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:31.290403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-34e00813-c15c-4f2b-ac5b-5a4137d64bde tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.150949 Aug 22 19:22:31.290959 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 279/541] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:31 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:32.194209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:32.194811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:32.196856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:32.202085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:32.202559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:32.202987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:32.203679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:32.204128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:32.204543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:32.310081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:32.310700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:32.312685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:32.313530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=6 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:32.319054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:32.319536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:32.319995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:32.320682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:32.321128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:32.321544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:32.330376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:32.338313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bc0865e-e876-4570-9157-391b0ded2226 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.147963 Aug 22 19:22:32.338874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 263/542] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:32 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:32.453655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:32.461854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5cfabea8-be75-430d-9ba2-d0596ac6d9d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.155539 Aug 22 19:22:32.462419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 280/543] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:32 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:33.359725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:33.360421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:33.367089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:33.367578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:33.368041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:33.368734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:33.369190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:33.369618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:33.482416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:33.483033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:33.489721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:33.490213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:33.490654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:33.491390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:33.491901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:33.492329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:33.628734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:33.637334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ca66cf8e-c451-4402-b760-a0db6b8a2747 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.158664 Aug 22 19:22:33.637920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 281/544] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:33 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:33.726761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:33.734420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0c4f9ca-c171-4bae-abb5-a4d44dc5a490 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.378772 Aug 22 19:22:33.734978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 264/545] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:33 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:34.657516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:34.658209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:34.665132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:34.665618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:34.666052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:34.666746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:34.667205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:34.667628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:34.755581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:34.756196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:34.762639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:34.763127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:34.763567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:34.764295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:34.764742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:34.765167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:34.800374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:34.808991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2e04ba2c-d45e-4b1f-865e-f67b65efc5d6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.155093 Aug 22 19:22:34.819708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 282/546] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:34 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:34.904574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:34.912942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c2c5f68-3836-4e17-95e0-1f97af6fed9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.161124 Aug 22 19:22:34.913435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 265/547] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:34 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:35.828695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:35.829307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:35.835701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:35.836290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:35.836729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:35.837417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:35.837865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:35.838285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:35.933593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:35.934277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:35.940268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:35.940960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:35.941228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:35.942621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:35.943271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:35.943728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:35.974845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:35.982495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-55af6fa8-574f-4c4c-8b45-acb5d7404e63 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.157615 Aug 22 19:22:35.983076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 283/548] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:35 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:36.075220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:36.083109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-622ddc18-931d-4079-9dc9-77411e7785b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.153311 Aug 22 19:22:36.083848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 266/549] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:35 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:37.003564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:37.004736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:37.011373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:37.011890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:37.012332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:37.013030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:37.013481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:37.013904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:37.105868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:37.107725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:37.120121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:37.123329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:37.125861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:37.126621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:37.127087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:37.127542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:37.158304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:37.167543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6c89377a-bddf-4f2a-8be3-25be2d309f45 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.167698 Aug 22 19:22:37.168516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 284/550] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:36 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:37.173137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-a9d8d4cf-ca70-4596-a5c1-4e9f71da336d req-a85c56a0-a42a-438b-b2db-039fd5c60c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2704afce-f4f6-491d-b146-17ed89f2b747", "name": "network-vif-plugged", "status": "completed", "tag": "d4252c5b-98aa-47dd-a413-17ffc2a1197c"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:37.183038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-a9d8d4cf-ca70-4596-a5c1-4e9f71da336d req-a85c56a0-a42a-438b-b2db-039fd5c60c6e service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:37.183550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-a9d8d4cf-ca70-4596-a5c1-4e9f71da336d req-a85c56a0-a42a-438b-b2db-039fd5c60c6e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:37.184006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-a9d8d4cf-ca70-4596-a5c1-4e9f71da336d req-a85c56a0-a42a-438b-b2db-039fd5c60c6e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:37.195875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-a9d8d4cf-ca70-4596-a5c1-4e9f71da336d req-a85c56a0-a42a-438b-b2db-039fd5c60c6e service nova] Creating event network-vif-plugged:d4252c5b-98aa-47dd-a413-17ffc2a1197c for instance 2704afce-f4f6-491d-b146-17ed89f2b747 on hv-cinder-83538 Aug 22 19:22:37.202394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-a9d8d4cf-ca70-4596-a5c1-4e9f71da336d req-a85c56a0-a42a-438b-b2db-039fd5c60c6e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032739 Aug 22 19:22:37.203516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 285/551] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:22:37.306622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:37.316161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64c11365-8398-41ea-966e-912c93faa32e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.215484 Aug 22 19:22:37.317898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 267/552] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:37 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:38.190922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:38.191620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:38.197734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:38.198213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:38.198647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:38.199365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:38.199853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:38.200280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:38.328203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:38.336310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-220e39b0-7aa9-483d-9f20-77fb6158cce8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.150008 Aug 22 19:22:38.336869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 286/553] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:38 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:38.337942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:38.338584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:38.344585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:38.345133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:38.345628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:38.346383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:38.346906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:38.347400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:38.475090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:38.482624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da242110-c053-4c6d-a34c-fc9f6143c682 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1318 microversion: 2.1 time: 0.148418 Aug 22 19:22:38.483179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 268/554] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:38 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:39.222555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-dd5b82dc-0d24-4c15-b095-899c90e50ced req-b3eba5d5-7447-4fb5-bbea-ce8bb64ffb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3f25ff-3b82-4e99-8f50-4b422b2f7b59", "name": "network-vif-plugged", "status": "completed", "tag": "e7503875-9afe-45eb-baf3-3daa6a183bc6"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:39.235376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-dd5b82dc-0d24-4c15-b095-899c90e50ced req-b3eba5d5-7447-4fb5-bbea-ce8bb64ffb1a service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:39.236077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-dd5b82dc-0d24-4c15-b095-899c90e50ced req-b3eba5d5-7447-4fb5-bbea-ce8bb64ffb1a service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:39.236511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-dd5b82dc-0d24-4c15-b095-899c90e50ced req-b3eba5d5-7447-4fb5-bbea-ce8bb64ffb1a service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:39.249182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-dd5b82dc-0d24-4c15-b095-899c90e50ced req-b3eba5d5-7447-4fb5-bbea-ce8bb64ffb1a service nova] Creating event network-vif-plugged:e7503875-9afe-45eb-baf3-3daa6a183bc6 for instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 on hv-cinder-83538 Aug 22 19:22:39.256417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-dd5b82dc-0d24-4c15-b095-899c90e50ced req-b3eba5d5-7447-4fb5-bbea-ce8bb64ffb1a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038125 Aug 22 19:22:39.257000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 287/555] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:22:39.356829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:39.357425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:39.363244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:39.364336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:39.364766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:39.365449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:39.365893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:39.366311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:39.503260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:39.503451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:39.504264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:39.511010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:39.511873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:39.512420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:39.513031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17a7e1da-035e-44dd-bc27-74072e2b0c73 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.158970 Aug 22 19:22:39.513396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:39.513639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 269/556] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:39 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:39.514046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:39.514574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:39.652537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:39.660195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-486afe78-3118-4f86-923d-41128bb28e7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1507 microversion: 2.1 time: 0.161536 Aug 22 19:22:39.661346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 288/557] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:39 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:22:40.534205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:40.535060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:40.543635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:40.544691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:40.545395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:40.546395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:40.547275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:40.547855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:40.593197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:40.719735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:40.728134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-262fdf58-9efe-4c7e-b3b6-61e20283eda5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.198048 Aug 22 19:22:40.728694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 270/558] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:40 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:41.748926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:41.749527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:41.755889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:41.756377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:41.756808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:41.757492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:41.757942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:41.758363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:41.889944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:41.898056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d8423ed4-c543-4440-95bf-b07903bcbac0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1267 microversion: 2.1 time: 0.153057 Aug 22 19:22:41.898623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 289/559] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:41 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:42.918923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:42.919672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:42.925762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:42.926336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:42.926828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:42.928172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:42.928627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:42.929051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:43.062954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:43.070670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e2d75064-6107-4c99-83fe-bc796608e21a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1454 microversion: 2.1 time: 0.155514 Aug 22 19:22:43.071316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 271/560] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:42 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:43.090342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:43.090989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:43.097656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:43.098140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:43.098576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:43.100051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:43.100539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:43.101015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:43.239191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:22:43.249455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e40aba8d-23c2-4b04-b0ab-d84c2046629b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1454 microversion: 2.1 time: 0.162807 Aug 22 19:22:43.250504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 290/561] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:22:43 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:22:45.318351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ac1711b6-0673-4b09-9dec-00e56547547d req-6402a0a7-60dc-4066-a625-5175c53a133e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3f25ff-3b82-4e99-8f50-4b422b2f7b59", "tag": "e7503875-9afe-45eb-baf3-3daa6a183bc6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:45.330754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ac1711b6-0673-4b09-9dec-00e56547547d req-6402a0a7-60dc-4066-a625-5175c53a133e service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:45.331179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ac1711b6-0673-4b09-9dec-00e56547547d req-6402a0a7-60dc-4066-a625-5175c53a133e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:45.331615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ac1711b6-0673-4b09-9dec-00e56547547d req-6402a0a7-60dc-4066-a625-5175c53a133e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:45.347548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ac1711b6-0673-4b09-9dec-00e56547547d req-6402a0a7-60dc-4066-a625-5175c53a133e service nova] Creating event network-changed:e7503875-9afe-45eb-baf3-3daa6a183bc6 for instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 on hv-cinder-83538 Aug 22 19:22:45.354046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ac1711b6-0673-4b09-9dec-00e56547547d req-6402a0a7-60dc-4066-a625-5175c53a133e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040320 Aug 22 19:22:45.357549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 272/562] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:22:50.169324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1523afc1-a5f7-4321-a388-7010ac455ec9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:50.169818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1523afc1-a5f7-4321-a388-7010ac455ec9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:50.176229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1523afc1-a5f7-4321-a388-7010ac455ec9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:50.176709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1523afc1-a5f7-4321-a388-7010ac455ec9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:50.177150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1523afc1-a5f7-4321-a388-7010ac455ec9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:50.177843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1523afc1-a5f7-4321-a388-7010ac455ec9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:50.178289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1523afc1-a5f7-4321-a388-7010ac455ec9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:50.178738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1523afc1-a5f7-4321-a388-7010ac455ec9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:50.201428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1523afc1-a5f7-4321-a388-7010ac455ec9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/ips" status: 200 len: 150 microversion: 2.1 time: 0.035854 Aug 22 19:22:50.202000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 291/563] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:22:50 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:22:52.278074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe55712d-6f4f-4066-bf47-93935634b765 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:22:52.279339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe55712d-6f4f-4066-bf47-93935634b765 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:52.281922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=48 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:22:52.295935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe55712d-6f4f-4066-bf47-93935634b765 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:52.296597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe55712d-6f4f-4066-bf47-93935634b765 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:52.297144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe55712d-6f4f-4066-bf47-93935634b765 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:52.298341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe55712d-6f4f-4066-bf47-93935634b765 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:52.298622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe55712d-6f4f-4066-bf47-93935634b765 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:52.299158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe55712d-6f4f-4066-bf47-93935634b765 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:52.354238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe55712d-6f4f-4066-bf47-93935634b765 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/ips" status: 200 len: 145 microversion: 2.1 time: 0.080503 Aug 22 19:22:52.355738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 273/564] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:22:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/ips => generated 145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:22:52.673026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7303ae21-4ace-4a3c-baf7-271a4711d386 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52c61c72-7da4-4bd8-b4b7-114b53fdb0f8"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:52.675275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7303ae21-4ace-4a3c-baf7-271a4711d386 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:52.681992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7303ae21-4ace-4a3c-baf7-271a4711d386 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:52.682470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7303ae21-4ace-4a3c-baf7-271a4711d386 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:52.683116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7303ae21-4ace-4a3c-baf7-271a4711d386 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:52.683851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7303ae21-4ace-4a3c-baf7-271a4711d386 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:52.684301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7303ae21-4ace-4a3c-baf7-271a4711d386 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:52.684894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7303ae21-4ace-4a3c-baf7-271a4711d386 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:53.071630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7303ae21-4ace-4a3c-baf7-271a4711d386 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402409 Aug 22 19:22:53.072645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 292/565] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Aug 22 19:22:52 2022] POST /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:22:57.766344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34993534-d885-4470-8fba-7c144dbf35be tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b028411-fbd8-417e-81b0-0d0de051be64"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:22:57.769359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34993534-d885-4470-8fba-7c144dbf35be tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:22:57.777336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34993534-d885-4470-8fba-7c144dbf35be tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:57.778082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34993534-d885-4470-8fba-7c144dbf35be tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:57.778685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34993534-d885-4470-8fba-7c144dbf35be tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:57.779598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34993534-d885-4470-8fba-7c144dbf35be tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:22:57.780309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34993534-d885-4470-8fba-7c144dbf35be tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:22:57.780923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34993534-d885-4470-8fba-7c144dbf35be tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:22:58.341962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34993534-d885-4470-8fba-7c144dbf35be tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "POST /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578910 Aug 22 19:22:58.344170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 274/566] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Aug 22 19:22:57 2022] POST /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:23:01.970754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-17e4692c-2496-4de8-8d51-1dbadd9c8962 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: .version_select at 0x7f66e405a310>, body: {"keypair": {"name": "tempest-keypair-1956240254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCii50VCWIQXz+/M+liE7Iguzbq+URnB6qhCW1M+ya3uo1RodUTg/eIq61MWEFN6kr+ctP9UrmXa7edH1MoJhu30YPzmkC4w76ANmwzSkrbI80otHVK1SFvkMb2g9lZdcg=="}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:01.986458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=34 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:02.007077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-17e4692c-2496-4de8-8d51-1dbadd9c8962 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:23:02.011206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-17e4692c-2496-4de8-8d51-1dbadd9c8962 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for user 61388384a318473e987ab06426509b69 and project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:23:02.039950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-17e4692c-2496-4de8-8d51-1dbadd9c8962 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074144 Aug 22 19:23:02.040871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 293/567] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 19:23:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:23:03.803434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-758267321", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b9dcfeb-0136-4b6f-b975-7fb15dd06c27"}], "security_groups": [{"name": "tempest-securitygroup--1113932209"}], "key_name": "tempest-keypair-1956240254", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:03.932394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] validate_networks() for [('0b9dcfeb-0136-4b6f-b975-7fb15dd06c27', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:23:04.416727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:23:04.419987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:23:04.422111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:23:04.422746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:23:04.423345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:23:04.439910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:04.440748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:04.441827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:04.444612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:04.445314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:04.446073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:04.467209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:23:04.478519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for user 61388384a318473e987ab06426509b69 and project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:23:04.492780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:23:04.495553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:23:04.555430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94ba492a-2723-4094-81a8-e76f37c938a8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.757516 Aug 22 19:23:04.556409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 275/568] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:23:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:23:04.564555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:04.569437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-81bea618-9713-4d86-9b39-fd2f00792929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:04.570441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-81bea618-9713-4d86-9b39-fd2f00792929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:04.667151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-81bea618-9713-4d86-9b39-fd2f00792929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:04.682596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-81bea618-9713-4d86-9b39-fd2f00792929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1241 microversion: 2.1 time: 0.119326 Aug 22 19:23:04.683174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 294/569] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:04 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:05.709614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:05.716374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:05.731969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:05.731969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:05.731969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:05.731969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:05.732340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:05.732340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:05.813512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:05.826241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55150561-380c-4097-a8fd-27f188dfa549 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1293 microversion: 2.1 time: 0.120834 Aug 22 19:23:05.826826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 276/570] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:05 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1293 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:06.829525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-61fdfd4b-30b0-4434-8b73-43351684b6a5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78e22809-455f-4dac-ab48-283ecffe2f83", "device": "/dev/sdb"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:06.833727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-61fdfd4b-30b0-4434-8b73-43351684b6a5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:06.842024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61fdfd4b-30b0-4434-8b73-43351684b6a5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:06.849225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:06.850909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:06.855774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61fdfd4b-30b0-4434-8b73-43351684b6a5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:06.857221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61fdfd4b-30b0-4434-8b73-43351684b6a5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:06.857978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61fdfd4b-30b0-4434-8b73-43351684b6a5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:06.858436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61fdfd4b-30b0-4434-8b73-43351684b6a5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:06.858862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61fdfd4b-30b0-4434-8b73-43351684b6a5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:06.869198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:06.880310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:06.880972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:06.881704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:06.888632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:06.889076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:07.001725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:07.013721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-711e4b61-ed53-44b6-be26-f57c91bd56f0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1299 microversion: 2.1 time: 0.170185 Aug 22 19:23:07.014383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 277/571] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:06 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1299 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:07.347098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-61fdfd4b-30b0-4434-8b73-43351684b6a5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "POST /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.529124 Aug 22 19:23:07.354855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 295/572] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Aug 22 19:23:06 2022] POST /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:23:07.919843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-feba8440-588f-4e6d-a4ae-fafcb300f3bd req-60210a44-78fc-47a3-9537-9c051e22b917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa", "tag": "31f49ec4-55fd-4cfa-bb24-b2fed1afff8b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:07.937521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-feba8440-588f-4e6d-a4ae-fafcb300f3bd req-60210a44-78fc-47a3-9537-9c051e22b917 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:07.938920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-feba8440-588f-4e6d-a4ae-fafcb300f3bd req-60210a44-78fc-47a3-9537-9c051e22b917 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:07.939524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-feba8440-588f-4e6d-a4ae-fafcb300f3bd req-60210a44-78fc-47a3-9537-9c051e22b917 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:07.964533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-feba8440-588f-4e6d-a4ae-fafcb300f3bd req-60210a44-78fc-47a3-9537-9c051e22b917 service nova] Creating event network-changed:31f49ec4-55fd-4cfa-bb24-b2fed1afff8b for instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa on hv-cinder-83538 Aug 22 19:23:07.970564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-feba8440-588f-4e6d-a4ae-fafcb300f3bd req-60210a44-78fc-47a3-9537-9c051e22b917 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056208 Aug 22 19:23:07.971191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 278/573] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:23:08.035807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:08.040341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:08.052663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:08.053152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:08.053586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:08.054291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:08.054740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:08.055166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:08.210838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:08.221448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c91f0b4e-f254-4226-b75d-5dec41945cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.189961 Aug 22 19:23:08.222663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 296/574] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:08 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:09.260722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:09.262299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:09.271078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:09.271983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:09.272650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:09.273697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:09.274390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:09.275044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:09.434141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a8b79a8b-18c7-4ebe-a524-a901bcf569ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:09.444154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8b79a8b-18c7-4ebe-a524-a901bcf569ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:09.445415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8b79a8b-18c7-4ebe-a524-a901bcf569ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:09.446470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8b79a8b-18c7-4ebe-a524-a901bcf569ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:09.532081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a8b79a8b-18c7-4ebe-a524-a901bcf569ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Going to try to stop instance {{(pid=120639) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 19:23:09.610625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a8b79a8b-18c7-4ebe-a524-a901bcf569ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "POST /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/action" status: 202 len: 0 microversion: 2.1 time: 0.180609 Aug 22 19:23:09.611229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 297/575] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:23:09 2022] POST /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:23:09.621985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:09.622742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:09.626691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:09.635890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6536961d-f2c7-4baf-a5c2-b1aab437e04a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.381685 Aug 22 19:23:09.636773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 279/576] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:09 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:09.648435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:09.649226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:09.649849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:09.650675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:09.651185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:09.651699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:09.855538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:09.865054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d5ae4603-cec2-4198-9a80-d6295b422196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.247868 Aug 22 19:23:09.865628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 298/577] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:09 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:10.198711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12623438-b695-4dae-a52c-32da9e0eaee5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Action: 'create', calling method: .version_select at 0x7f66e40f74c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1884222474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHO48R7M8RneIeMPFxTmwm7OnJMLj73sEPjAtqtmoOJdKGuzryHXuDgb/CjQwIFHXz06xhnG/X/ob2I2fPdHuO3sC7HW2CeK7Rbi3V9Q9Rb9tAPrW0/BDlrrUhxmEUlUg=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:10.213565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-12623438-b695-4dae-a52c-32da9e0eaee5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Getting quotas for project ec13a665e661424fa8602f7fbd962e16. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:23:10.218489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-12623438-b695-4dae-a52c-32da9e0eaee5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Getting quotas for user cea80d48ea4a467d96ca9dfe2671bdd7 and project ec13a665e661424fa8602f7fbd962e16. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:23:10.241757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12623438-b695-4dae-a52c-32da9e0eaee5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046913 Aug 22 19:23:10.242345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 280/578] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 19:23:10 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:23:10.292517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2123644843", "imageRef": "554a9f67-ce91-4e9b-8336-569f3faf77f3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1884222474", "networks": [{"uuid": "e0dcf4b3-282f-4e3f-82e6-ab4cc5d4d329"}]}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:10.343657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] validate_networks() for [('e0dcf4b3-282f-4e3f-82e6-ab4cc5d4d329', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:23:10.656237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:10.656994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:10.664288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:10.664840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:10.665337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:10.666088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:10.666608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:10.667094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:10.673876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:10.704640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:23:10.705187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:23:10.705509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:23:10.705912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:23:10.706319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:23:10.715422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:10.715933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:10.716362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:10.717075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:10.717515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:10.717931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:10.735070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Getting quotas for project ec13a665e661424fa8602f7fbd962e16. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:23:10.738998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Getting quotas for user cea80d48ea4a467d96ca9dfe2671bdd7 and project ec13a665e661424fa8602f7fbd962e16. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:23:10.750549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:23:10.752970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='554a9f67-ce91-4e9b-8336-569f3faf77f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:23:10.798453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ca3e7044-d52c-471b-a168-39c0857607ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509677 Aug 22 19:23:10.805674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 299/579] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:23:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:23:10.807678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:10.815895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-51956d99-89d5-45c1-837d-5c60e531b690 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:10.816505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-51956d99-89d5-45c1-837d-5c60e531b690 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:10.816630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-100c4714-6ca9-4c84-bdcf-e9dab0a3f46c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.164005 Aug 22 19:23:10.817304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 281/580] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:10 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:10.877031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-51956d99-89d5-45c1-837d-5c60e531b690 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:10.884415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-51956d99-89d5-45c1-837d-5c60e531b690 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1259 microversion: 2.1 time: 0.072479 Aug 22 19:23:10.885171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 300/581] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:10 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:10.887040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:10.887680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:10.894778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:10.895291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:10.896154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:10.896858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:10.897308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:10.897728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:11.046726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:11.055841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b12ef1c-8b3c-44b4-a8b9-230d8323a196 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.173254 Aug 22 19:23:11.056071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 282/582] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:11.837919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:11.838526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:11.844953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:11.845449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:11.845868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:11.846552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:11.847004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:11.847423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:11.904671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:11.905342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:11.912250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:11.912739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:11.913173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:11.913865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:11.914316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:11.914739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:11.974374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:11.975158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:11.982031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38e495cc-90c1-4449-ae9f-2c1f364559a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1263 microversion: 2.1 time: 0.081132 Aug 22 19:23:11.982559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d78a0ea9-cb92-4108-b6f4-859cb4c374fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.148457 Aug 22 19:23:11.982720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 283/583] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:11 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:11.983110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 301/584] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:11 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:12.076866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:12.077477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:12.084083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:12.084567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:12.085012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:12.085701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:12.086156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:12.086576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:12.217739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:12.226138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66a4fc97-87b6-4163-b00f-d6eae31690cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.153066 Aug 22 19:23:12.226705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 284/585] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:12 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:13.002333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:13.002871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:13.002983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:13.003502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:13.009526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:13.009977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:13.010104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:13.010447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:13.010570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:13.010885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:13.011154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:13.011580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:13.011708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:13.012048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:13.012148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:13.012469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:13.072538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:13.080207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ac50c4fe-29f3-46da-b90b-8967cc96f7c8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1263 microversion: 2.1 time: 0.081751 Aug 22 19:23:13.080780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 302/586] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:12 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:13.140961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:13.148852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e62ce65-385a-4211-beb0-06fdb6c8d106 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.149657 Aug 22 19:23:13.149483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 285/587] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:12 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:13.246718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:13.247357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:13.253328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:13.253750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:13.254190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:13.254894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:13.255345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:13.255791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:13.385250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:13.393282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b43a4eb5-c9dc-4d34-bc7d-15eff84b06c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.150408 Aug 22 19:23:13.393835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 303/588] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:13 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:14.100840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:14.101402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:14.108212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:14.108691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:14.109142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:14.109834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:14.110279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:14.110702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:14.169913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:14.170592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:14.171430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:14.177259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:14.177808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:14.178307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:14.179060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:14.179164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-649d7533-f043-4784-b1af-a9498096803b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1311 microversion: 2.1 time: 0.083023 Aug 22 19:23:14.179627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 286/589] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:14.179761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:14.180197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:14.415108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:14.415768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:14.421777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:14.422272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:14.422761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:14.423470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:14.424023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:14.424647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:14.458651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:14.498420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:14.507563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ecd95677-86f3-496d-ad67-1d5ecf7fa6c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.341485 Aug 22 19:23:14.508507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 304/590] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:14 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:14.868341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:14.896613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb514c4a-8571-4971-a0dc-de284c5480c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.485605 Aug 22 19:23:14.898026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 287/591] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:15.200975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:15.201603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:15.212270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:15.212774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:15.213259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:15.214208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:15.214815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:15.215477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:15.285786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:15.296641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0748f197-6f5e-4a4e-83dc-b223a8c34688 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1317 microversion: 2.1 time: 0.100446 Aug 22 19:23:15.297625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 305/592] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:15 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:15.530980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:15.532496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:15.545335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:15.545832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:15.546910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:15.547121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:15.547419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:15.547875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:15.701813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:15.710552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a61b572-32cf-4075-a3fe-f99905574a3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.183861 Aug 22 19:23:15.711628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 288/593] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:15 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:15.917585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:15.918279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:15.924267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:15.924942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:15.925188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:15.925887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:15.926567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:15.926996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:16.066165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:16.076681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1b7dc473-1bac-4093-80aa-67c7305859cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.162724 Aug 22 19:23:16.091695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 306/594] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:16.319134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:16.319689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:16.325699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:16.326191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:16.326620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:16.327313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:16.327809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:16.328235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:16.466281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:16.474837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78615a04-3929-46f1-9bce-d65135d2b660 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.160360 Aug 22 19:23:16.476589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 289/595] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:16 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:16.733443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:16.734101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:16.741647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:16.742270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:16.742760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:16.743520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:16.744071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:16.744585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:16.892944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:16.902412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-361d87d2-88c7-44b5-a0a1-fe1d759a3659 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.173416 Aug 22 19:23:16.903519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 307/596] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:16 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:17.099148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:17.099798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:17.106438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:17.106935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:17.107371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:17.112567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:17.112567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:17.112567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:17.299110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:17.309891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f8a25d8-113c-4799-883f-870f270cc5c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.215327 Aug 22 19:23:17.315785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 290/597] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:17 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:17.496335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:17.496864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:17.503037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:17.503513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:17.503988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:17.504677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:17.505121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:17.505539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:17.648360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:17.656050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-21fa6856-4cd6-4c0f-aba4-5368819b40e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.163512 Aug 22 19:23:17.669697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 308/598] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:17.924270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:17.925405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:17.937432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:17.937923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:17.938356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:17.939114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:17.952366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:17.952816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:17.983281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-4e9807df-2882-4c2c-b6fb-6988fc995cdf req-179e8a06-f997-43be-bc44-1f820cdb13ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa", "name": "network-vif-plugged", "status": "completed", "tag": "31f49ec4-55fd-4cfa-bb24-b2fed1afff8b"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:18.004997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-4e9807df-2882-4c2c-b6fb-6988fc995cdf req-179e8a06-f997-43be-bc44-1f820cdb13ff service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:18.005633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-4e9807df-2882-4c2c-b6fb-6988fc995cdf req-179e8a06-f997-43be-bc44-1f820cdb13ff service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:18.006167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-4e9807df-2882-4c2c-b6fb-6988fc995cdf req-179e8a06-f997-43be-bc44-1f820cdb13ff service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:18.018808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-4e9807df-2882-4c2c-b6fb-6988fc995cdf req-179e8a06-f997-43be-bc44-1f820cdb13ff service nova] Creating event network-vif-plugged:31f49ec4-55fd-4cfa-bb24-b2fed1afff8b for instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa on hv-cinder-83538 Aug 22 19:23:18.025368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-4e9807df-2882-4c2c-b6fb-6988fc995cdf req-179e8a06-f997-43be-bc44-1f820cdb13ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045679 Aug 22 19:23:18.026559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 309/599] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:23:18.136473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:18.144839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a964de29-de31-4b13-b7f4-9e8da4da10e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.224967 Aug 22 19:23:18.146632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 291/600] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:17 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:18.333141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:18.333845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:18.340086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:18.340570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:18.341006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:18.341693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:18.342142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:18.342564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:18.479331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:18.490659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-951ff4be-d546-4774-a399-c9cc9ab93e81 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.161519 Aug 22 19:23:18.503061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 310/601] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:18 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:18.680775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:18.681396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:18.687700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:18.688270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:18.688704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:18.689389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:18.689839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:18.690259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:18.821411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:18.830113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce3871a3-5b0d-43bf-8665-ac4af9ccf5ab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.153691 Aug 22 19:23:18.830934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 292/602] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:18 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:19.166720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:19.167363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:19.184172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:19.184822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:19.185333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:19.186140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:19.186837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:19.187442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:19.206796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:19.329221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:19.337299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-55ac323b-e3b4-45fc-beef-269f7bac6175 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.174329 Aug 22 19:23:19.337880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 311/603] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:19 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:19.512966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:19.513606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:19.519924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:19.520404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:19.520829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:19.521510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:19.521953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:19.522370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:19.655509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:19.665272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b43bb111-ded5-4bcc-922b-f79566486651 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.156043 Aug 22 19:23:19.676199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 293/604] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:19.851112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:19.851660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:19.857730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:19.858213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:19.858651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:19.859354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:19.859831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:19.860263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:19.999291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:20.007143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-65ab15fa-0f43-45b4-8fdc-6992c4044b89 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.160683 Aug 22 19:23:20.007755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 312/605] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:19 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:20.358290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:20.358908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:20.365125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:20.367018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:20.367665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:20.368133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:20.368846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:20.369304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:20.369726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:20.512350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:20.520237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60c27170-16d1-4202-9165-cafbed82069e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.165771 Aug 22 19:23:20.520945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 294/606] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:20 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:20.698549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:20.699500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:20.706227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:20.706708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:20.707195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:20.707876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:20.708332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:20.708753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:20.729318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:20.847616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:20.856270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1a9da1bc-6561-4415-870c-3f4200ae82cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.163198 Aug 22 19:23:20.856839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 313/607] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:20 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:21.027874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:21.028838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:21.041022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:21.041787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:21.042289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:21.043137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:21.043668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:21.044165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:21.200608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:21.208353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-46e9d5b1-12e6-498f-bac3-4193b04d550c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.184547 Aug 22 19:23:21.208952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 295/608] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:21 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:21.541994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:21.542531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:21.544379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=14 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:21.549799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:21.550285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:21.550719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:21.551416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:21.551906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:21.552370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:21.689000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:21.697310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ef5ac764-ad19-40b8-bc8f-64eeefd516b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.159242 Aug 22 19:23:21.697877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 314/609] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:21 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:21.877015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:21.877604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:21.884357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:21.884843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:21.885282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:21.885986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:21.886436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:21.886858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:22.028794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:22.042013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd5fd308-3f8d-4991-b61a-e5ee4b6fc475 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.168903 Aug 22 19:23:22.049391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 296/610] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:21 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:22.229394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:22.230167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:22.236482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:22.237310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:22.237967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:22.238950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:22.239613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:22.240306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:22.385813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:22.393856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2401077f-e3b7-45da-82d9-4eacf80c79bd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.168023 Aug 22 19:23:22.394505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 315/611] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:22 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:22.718005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:22.718839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:22.720730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:22.726982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:22.727471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:22.727932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:22.728873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:22.729320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:22.729743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:22.870429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:22.872900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:22.880025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84fd709b-a7c5-4e1e-ba67-3d7ae2db82fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.165802 Aug 22 19:23:22.881045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 297/612] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:22 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:23.063633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:23.064192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:23.073243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:23.073684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:23.074176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:23.075154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:23.075667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:23.076108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:23.223207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:23.234284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c7052c25-92b0-4b2f-abbe-e896889835ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.174443 Aug 22 19:23:23.234942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 316/613] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:23 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:23.415591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:23.416237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:23.423082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:23.423712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:23.424247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:23.425031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:23.425561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:23.426054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:23.579070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:23.587629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fc02132-54e7-45c3-b87f-f737beb485f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.176211 Aug 22 19:23:23.591859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 298/614] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:23 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:23.967153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:23.967800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:23.974088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:23.974570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:23.975006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:23.975722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:23.976173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:23.976596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:24.119135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:24.126889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-df8f3804-f3fb-4c52-b124-6eca14b5f44c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.229810 Aug 22 19:23:24.136175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 317/615] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:23 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:24.361275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:24.361881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:24.368622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:24.369113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:24.369541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:24.370228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:24.370674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:24.371087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:24.514753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:24.523492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e356539b-9002-44d0-b90b-73e851ad41ea tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.272416 Aug 22 19:23:24.524080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 299/616] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:24.609406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:24.609983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:24.616109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:24.616619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:24.617060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:24.617816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:24.618292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:24.618731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:24.748725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:24.757318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4e432fae-d4e4-4b35-9990-7702c3cf1c46 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.151810 Aug 22 19:23:24.758115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 318/617] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:24 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:25.150106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:25.151115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:25.157308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:25.157822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:25.158285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:25.158992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:25.159446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:25.159895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:25.291304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:25.299311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a13d589-4440-451f-88ad-eb5c4f635853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.154456 Aug 22 19:23:25.299915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 300/618] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:25 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:25.546130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:25.546740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:25.553628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:25.554104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:25.554821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:25.555508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:25.556086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:25.556386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:25.685642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:25.693665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7ec620f9-bbec-465e-8eaf-a936830dccd7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.151357 Aug 22 19:23:25.694226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 319/619] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:25 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:25.778319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:25.778848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:25.785271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:25.785760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:25.786199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:25.787402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:25.787910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:25.788336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:25.917959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:25.925520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-68806728-6b5f-4d8f-abbe-b0123d687a19 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.151164 Aug 22 19:23:25.926086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 301/620] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:25 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:26.319432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:26.320074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:26.325993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:26.326476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:26.326907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:26.327584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:26.328056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:26.328473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:26.452564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:26.460998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-beb35a67-04e8-4b5c-a5a0-105710ffc5d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.145384 Aug 22 19:23:26.461562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 320/621] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:26 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:26.714592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:26.715204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:26.721133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:26.721607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:26.722041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:26.722727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:26.723431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:26.723880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:26.850092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:26.858249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3eedb02-dc7e-41ac-b711-f0475515e1ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.147499 Aug 22 19:23:26.858802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 302/622] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:26 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:26.945341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:26.945943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:26.952238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:26.952804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:26.953227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:26.953905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:26.954345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:26.954766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:27.082706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:27.090747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-86a454e0-e2f5-4cd7-958d-091a5f559e5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.149213 Aug 22 19:23:27.091303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 321/623] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:26 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:27.482048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:27.482656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:27.488521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:27.489016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:27.489426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:27.490614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:27.491059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:27.491477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:27.620407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:27.627833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c6e1c08-9664-40a3-8e7f-fabc9aaf08eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.149610 Aug 22 19:23:27.628864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 303/624] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:27 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:27.878825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:27.879429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:27.885898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:27.886377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:27.886808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:27.887493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:27.887977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:27.888395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:28.013673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:28.021712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e2729699-cc86-45d0-af96-28868c16fd74 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.146703 Aug 22 19:23:28.022272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 322/625] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:28.112252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:28.112801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:28.119233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:28.119745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:28.120177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:28.120864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:28.121381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:28.121836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:28.248453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:28.255969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab5b186b-935b-41ef-961b-b94a0ddd201f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.147777 Aug 22 19:23:28.256526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 304/626] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:28 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:28.649672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:28.650282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:28.656232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:28.656710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:28.657144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:28.657824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:28.658267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:28.658688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:28.787745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:28.795439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0045acc1-e795-4701-8e72-b20d6c1f2d1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.150218 Aug 22 19:23:28.796043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 323/627] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:28 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:29.042294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:29.042903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:29.048954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:29.049436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:29.049871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:29.050563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:29.051015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:29.051437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:29.275704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:29.276506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:29.283316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:29.284021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:29.284546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:29.285311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:29.285828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:29.287801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:29.303151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:29.311962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a6f6d7d-83a7-42fa-a617-a1d50e3ed7b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1722 microversion: 2.1 time: 0.273374 Aug 22 19:23:29.312530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 305/628] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:29 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:29.418093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:29.425978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b65047f9-995d-40ff-8743-ab61a763698a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.154147 Aug 22 19:23:29.426551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 324/629] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:29 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:29.706186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-750719e4-ce7e-481d-b446-e594922960a8 req-555f6098-dc31-4b8c-9c6d-509563a8d572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9698a0b1-a98a-40e1-9093-39946273a155", "tag": "23337ac5-214c-419d-b22b-ad62bd9b3776"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:29.716409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-750719e4-ce7e-481d-b446-e594922960a8 req-555f6098-dc31-4b8c-9c6d-509563a8d572 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:29.716885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-750719e4-ce7e-481d-b446-e594922960a8 req-555f6098-dc31-4b8c-9c6d-509563a8d572 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:29.717314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-750719e4-ce7e-481d-b446-e594922960a8 req-555f6098-dc31-4b8c-9c6d-509563a8d572 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:29.729289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-750719e4-ce7e-481d-b446-e594922960a8 req-555f6098-dc31-4b8c-9c6d-509563a8d572 service nova] Creating event network-changed:23337ac5-214c-419d-b22b-ad62bd9b3776 for instance 9698a0b1-a98a-40e1-9093-39946273a155 on hv-cinder-83538 Aug 22 19:23:29.733914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-750719e4-ce7e-481d-b446-e594922960a8 req-555f6098-dc31-4b8c-9c6d-509563a8d572 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032223 Aug 22 19:23:29.734507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 306/630] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:23:29.815888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:29.816506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:29.822973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:29.823465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:29.823931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:29.824635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:29.825101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:29.825538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:29.962607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:29.970308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-13a74af1-e3d5-49a3-9c7a-c4a7743ca6f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.158279 Aug 22 19:23:29.970910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 325/631] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:29 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:30.334715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:30.335490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:30.342375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:30.342861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:30.343298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:30.344039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:30.344481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:30.344906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:30.448018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:30.448724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:30.455872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:30.456740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:30.457175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:30.457876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:30.459634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:30.460071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:30.600588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:30.608313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a29c00ae-f041-4e4f-b1e0-bd6a5cce3088 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.166001 Aug 22 19:23:30.609154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 326/632] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:30 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:30.658559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:30.667592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa09c42e-9260-4bcc-8077-30f978f75d42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1699 microversion: 2.1 time: 0.338115 Aug 22 19:23:30.668116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 307/633] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1699 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:30.687517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d29c64e2-c2f3-4cf7-8ada-49c4cf848c23 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:30.693533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d29c64e2-c2f3-4cf7-8ada-49c4cf848c23 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:30.694014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d29c64e2-c2f3-4cf7-8ada-49c4cf848c23 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:30.694451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d29c64e2-c2f3-4cf7-8ada-49c4cf848c23 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:30.716119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d29c64e2-c2f3-4cf7-8ada-49c4cf848c23 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Going to try to start instance {{(pid=120639) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 19:23:30.732956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:30.756290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d29c64e2-c2f3-4cf7-8ada-49c4cf848c23 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "POST /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/action" status: 202 len: 0 microversion: 2.1 time: 0.072553 Aug 22 19:23:30.756902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 327/634] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:23:30 2022] POST /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:23:30.764995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:30.765599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:30.772073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:30.772545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:30.772972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:30.773652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:30.774106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:30.774524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:30.904508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:30.913221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7b0c11f-decd-455d-93ee-13ad1e37ab7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.152066 Aug 22 19:23:30.913784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 308/635] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:30.992849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:30.993636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:30.995537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:31.000805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:31.001289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:31.001729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:31.002427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:31.002875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:31.003301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:31.135732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:31.143548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-91a3f014-0c05-4e4d-aa55-5b7a03b7eaf7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.155650 Aug 22 19:23:31.144334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 328/636] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:30 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:31.629326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:31.629874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:31.636714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:31.637203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:31.637644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:31.638335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:31.638793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:31.639219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:31.768206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:31.776777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b42e3e4e-64ba-4403-8f43-5e0e1914468b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.151437 Aug 22 19:23:31.777350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 309/637] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:31 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:31.933846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:31.934461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:31.940933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:31.941411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:31.941845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:31.943152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:31.943626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:31.944074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:32.075235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:32.083335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fbd49243-fc97-4625-b084-5b9b13873956 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.153314 Aug 22 19:23:32.083931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 329/638] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:32.164582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:32.165186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:32.171373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:32.171885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:32.172316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:32.173089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:32.173534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:32.173951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:32.299178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:32.307435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a533f97f-0009-479a-932c-42cc293a5b91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.146668 Aug 22 19:23:32.308045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 310/639] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:32 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:32.797397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:32.798013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:32.803982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:32.804465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:32.804898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:32.805583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:32.806033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:32.806456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:32.929933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:32.937462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-065e6626-a342-4a3a-9f80-30b8da9ce1c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.143908 Aug 22 19:23:32.938043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 330/640] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:32 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:33.103892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:33.104705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:33.111352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:33.111879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:33.112401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:33.113109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:33.113566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:33.113991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:33.240054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:33.248196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8d7f713c-75be-4ced-8293-288f56296287 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.148242 Aug 22 19:23:33.248759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 311/641] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:33 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:33.327835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:33.328451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:33.334795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:33.335276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:33.335743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:33.336434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:33.336887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:33.337311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:33.467323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:33.475753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-21fa9e41-7c81-4b9b-a0fc-1a27205d8fa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.151722 Aug 22 19:23:33.476316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 331/642] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:33 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:33.956992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:33.957779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:33.963803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:33.964283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:33.964712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:33.965393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:33.965837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:33.966253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:34.092928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:34.101802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-573b08f0-ff43-4dfe-9b38-f2382fe56975 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.148700 Aug 22 19:23:34.102392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 312/643] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:33 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:34.269603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:34.270138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:34.276508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:34.276981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:34.277410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:34.278091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:34.278535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:34.278951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:34.410131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:34.419463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2b610cb6-b081-4de4-a777-f2ece72ed63f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.154096 Aug 22 19:23:34.420056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 332/644] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:34.495700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:34.496313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:34.502650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:34.503130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:34.503564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:34.504276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:34.504728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:34.505640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:34.630870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:34.638374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff47198c-f85c-4d46-ad5d-95038ae28ef0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.146553 Aug 22 19:23:34.638937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 313/645] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:34 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:35.122508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:35.123118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:35.129061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:35.129533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:35.130621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:35.131297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:35.131770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:35.132190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:35.258693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:35.266551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d8d1e8dd-4684-43db-a016-ffa4ca9517e1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.148175 Aug 22 19:23:35.267103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 333/646] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:35 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:35.440218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:35.440823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:35.446747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:35.447219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:35.447731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:35.448347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:35.448790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:35.449206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:35.578157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:35.586120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f5cdd4d-09d2-405c-bc77-cd41118ba3eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.149665 Aug 22 19:23:35.586667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 314/647] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:35 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:35.659448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:35.660091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:35.666998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:35.667496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:35.667960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:35.668646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:35.669090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:35.669510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:35.806021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:35.813681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-46f5ec36-b606-4833-a42f-c767e0b22320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.158051 Aug 22 19:23:35.814264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 334/648] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:35 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:36.287133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:36.288117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:36.294494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:36.295101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:36.295611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:36.296584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:36.297044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:36.297472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:36.300644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:36.608109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:36.608764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:36.615217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:36.615728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:36.616170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:36.616870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:36.617324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:36.617749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:36.746741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:36.755686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-48804cb0-1d9a-4add-acdc-18a73bbe6a97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.150935 Aug 22 19:23:36.756352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 335/649] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:36.760014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:36.767893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9076f81-c3d2-4384-bf71-89c90c9fe495 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.484716 Aug 22 19:23:36.768471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 315/650] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:36 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:36.834927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:36.835455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:36.841496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:36.841980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:36.842417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:36.843114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:36.843563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:36.844011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:36.973644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:36.981212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-012ae4dd-bf75-4272-b8b9-3da65b776330 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.150884 Aug 22 19:23:36.981780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 336/651] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:36 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:37.775878 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:37.776483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:37.783860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:37.784354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:37.785004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:37.785716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:37.786979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:37.787098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:37.789046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:37.789491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:37.797047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:37.797533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:37.797961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:37.798659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:37.799106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:37.799526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:37.919597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:37.927293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:37.927798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-582c37de-d42e-47d1-b411-f2b75f0d0e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.155688 Aug 22 19:23:37.928365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 316/652] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:37.935198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b14bbbf-cf2f-44b5-a466-44af592d23c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.150770 Aug 22 19:23:37.935867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 337/653] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:37 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:38.000784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:38.001388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:38.007108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:38.008044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:38.008479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:38.009161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:38.009614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:38.010031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:38.141738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:38.150003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-383a0070-b2e9-4f36-9bed-38e40339c363 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.152920 Aug 22 19:23:38.150582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 317/654] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:37 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:38.949121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:38.949772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:38.955307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:38.955943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:38.956357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:38.956841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:38.957278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:38.958475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:38.958919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:38.959346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:38.962448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:38.962929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:38.963366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:38.964080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:38.964536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:38.964956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:39.086809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:39.091864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:39.095263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-46fc7e17-20d8-453f-911c-964464dd33cb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.149957 Aug 22 19:23:39.095858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 338/655] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:39.101105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b8cd1938-6c73-41fd-9ecb-90f3bb127219 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.149580 Aug 22 19:23:39.101765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 318/656] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:38 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:39.170653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:39.171262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:39.177098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:39.177582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:39.178013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:39.178700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:39.179151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:39.179573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:39.307451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:39.315439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-31a1eb72-7844-4171-bd5f-6423be18f205 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.148587 Aug 22 19:23:39.316031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 339/657] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:39 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:40.117383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:40.117975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:40.121037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:40.121652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:40.124409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:40.124895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:40.125325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:40.126012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:40.126463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:40.126891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:40.128149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:40.128630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:40.129205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:40.129869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:40.130319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:40.130747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:40.258848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:40.260505 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:40.266601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-165a9fe7-066d-436a-b7e4-bc346d2f7ec4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.149307 Aug 22 19:23:40.267163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 340/658] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:40 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:40.268836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1ec56fc-5c83-48c7-b4e8-8b03233058f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.155982 Aug 22 19:23:40.269493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 319/659] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:40.336384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:40.337012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:40.342931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:40.343414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:40.343938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:40.344623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:40.345064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:40.345484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:40.476883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:40.484456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-41006621-1c79-47fa-b9c0-677873138111 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.151987 Aug 22 19:23:40.485011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 341/660] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:40 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:41.287825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:41.288434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:41.288953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:41.289589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:41.294906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:41.295382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:41.295749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:41.295868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:41.296234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:41.296536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:41.296669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:41.296982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:41.297362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:41.297499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:41.297817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:41.298241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:41.432796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:41.442582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-695fd51a-b776-42b3-bfef-12a53d92475f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.158217 Aug 22 19:23:41.443307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 320/661] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:41 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:41.447092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:41.455568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3c30cae7-41c7-4aee-86ae-42f3f0fe4e43 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.170313 Aug 22 19:23:41.456174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 342/662] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:41.505799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:41.506434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:41.512612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:41.513094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:41.513522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:41.514211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:41.514663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:41.515082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:41.649152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:41.657119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42fbb06b-a177-44a1-9fe6-a9afaf54a1b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1367 microversion: 2.1 time: 0.155607 Aug 22 19:23:41.657834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 321/663] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:41 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:42.464940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:42.465558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:42.472089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:42.472834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:42.473281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:42.473997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:42.474568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:42.474994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:42.478168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:42.478820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:42.485099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:42.485625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:42.486055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:42.486748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:42.487194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:42.487612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:42.618844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:42.625051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:42.629787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:42.634547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efa47913-1401-4aa0-a9f2-34339af31cd9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.160699 Aug 22 19:23:42.634728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-65d00d24-1a66-4e90-a7ce-9523d9b9bf6f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.173625 Aug 22 19:23:42.635363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 322/664] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:23:42.635489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 343/665] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:42.678914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:42.680259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:42.687130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:42.687939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:42.689310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:42.690551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:42.691672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:42.692371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:42.955172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:42.963394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bbf5b8dd-64c8-4d0e-a97e-836ecb8ea3d0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1557 microversion: 2.1 time: 0.290116 Aug 22 19:23:42.964002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 323/666] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:42 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1557 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:42.983981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7c908730-1676-4c80-85f6-af8e0f784b27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:42.984576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7c908730-1676-4c80-85f6-af8e0f784b27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:42.991241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c908730-1676-4c80-85f6-af8e0f784b27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:42.991753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c908730-1676-4c80-85f6-af8e0f784b27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:42.992192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c908730-1676-4c80-85f6-af8e0f784b27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:42.992887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c908730-1676-4c80-85f6-af8e0f784b27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:42.993338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c908730-1676-4c80-85f6-af8e0f784b27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:42.993756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c908730-1676-4c80-85f6-af8e0f784b27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:43.072462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7c908730-1676-4c80-85f6-af8e0f784b27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092731 Aug 22 19:23:43.073061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 344/667] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Aug 22 19:23:42 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:23:43.656441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:43.657362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:43.663813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:43.664443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:43.664711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:43.665208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:43.665646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:43.666395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:43.666831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:43.667257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:43.671673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:43.672331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:43.672840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:43.673630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:43.674153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:43.674649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:43.807666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:43.816343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38a4cf3a-419b-417a-b25d-0911a6a03850 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.163825 Aug 22 19:23:43.816917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 324/668] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:44.036547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:44.044017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b8d03b40-ad93-46e3-b1cc-de85378a0afd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.385467 Aug 22 19:23:44.044578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 345/669] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:43 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:44.302531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-627ce2e6-4d86-4834-8c6d-dc432dc68843 req-e7f2907b-ddd1-4eab-b6f7-afc8f17fe853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa", "tag": "31f49ec4-55fd-4cfa-bb24-b2fed1afff8b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:44.311787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-627ce2e6-4d86-4834-8c6d-dc432dc68843 req-e7f2907b-ddd1-4eab-b6f7-afc8f17fe853 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:44.312265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-627ce2e6-4d86-4834-8c6d-dc432dc68843 req-e7f2907b-ddd1-4eab-b6f7-afc8f17fe853 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:44.312692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-627ce2e6-4d86-4834-8c6d-dc432dc68843 req-e7f2907b-ddd1-4eab-b6f7-afc8f17fe853 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:44.323927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-627ce2e6-4d86-4834-8c6d-dc432dc68843 req-e7f2907b-ddd1-4eab-b6f7-afc8f17fe853 service nova] Creating event network-changed:31f49ec4-55fd-4cfa-bb24-b2fed1afff8b for instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa on hv-cinder-83538 Aug 22 19:23:44.328912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-627ce2e6-4d86-4834-8c6d-dc432dc68843 req-e7f2907b-ddd1-4eab-b6f7-afc8f17fe853 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084535 Aug 22 19:23:44.329509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 325/670] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:23:44.837364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:44.838175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:44.844352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:44.844914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:44.845419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:44.846185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:44.846709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:44.847141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:44.977448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:44.985803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f6d0585d-b05e-4fce-a46b-816993b62f24 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.152230 Aug 22 19:23:44.986373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 346/671] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:44 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:45.066438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:45.067061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:45.073537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:45.074018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:45.074449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:45.075146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:45.075591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:45.076056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:45.212452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:45.220476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9af91c8f-24ab-4ba8-8845-2cf4a0679a47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.159304 Aug 22 19:23:45.221051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 326/672] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:45 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:46.006728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:46.007337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:46.013881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:46.014302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:46.014736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:46.015433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:46.015907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:46.016332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:46.148420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:46.157292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fb7554bb-0561-4a58-9537-cbfb7d5c667c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.154929 Aug 22 19:23:46.157857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 347/673] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:46.242215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:46.242818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:46.249242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:46.249716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:46.250146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:46.250828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:46.251270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:46.251716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:46.377548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:46.385738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7eb2e92-4871-457f-82e1-98774a40c2bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.147799 Aug 22 19:23:46.386297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 327/674] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:46 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:47.178793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:47.179429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:47.185789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:47.186287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:47.186717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:47.187391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:47.187926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:47.188331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:47.314082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:47.322096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5f6ddd3a-2656-4ae9-9480-6026f3ddf150 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.147632 Aug 22 19:23:47.322663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 348/675] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:47.405631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:47.406157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:47.413016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:47.413497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:47.413933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:47.414628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:47.415106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:47.415528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:47.547451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:47.555630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8fb103b9-6ba7-41de-8190-ebcbd4358126 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.153887 Aug 22 19:23:47.556215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 328/676] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:47 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:48.342861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:48.343473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:48.350158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:48.350640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:48.351072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:48.351782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:48.352235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:48.352661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:48.489906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:48.498386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ca8c4a8b-5724-46dd-aff8-28fbf8cd052e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.159363 Aug 22 19:23:48.498951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 349/677] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:48.575232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:48.575865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:48.582200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:48.582676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:48.583109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:48.583820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:48.584267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:48.584683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:48.715730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:48.723550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a220edd0-49ac-4b8c-a56c-f18ec15e239e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.152134 Aug 22 19:23:48.724141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 329/678] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:48 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:49.519357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:49.519988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:49.526820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:49.527292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:49.527753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:49.528434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:49.528878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:49.529292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:49.655340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:49.663431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-71350c48-9b74-4db9-9636-22cfafa67896 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.147873 Aug 22 19:23:49.664025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 350/679] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:49.743153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:49.743780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:49.750058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:49.750531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:49.750960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:49.751637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:49.752131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:49.752552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:49.877360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:49.885645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c9c9669-4d56-48dc-96d6-4b82e63c9fc4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.146258 Aug 22 19:23:49.886213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 330/680] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:49 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:50.684347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:50.684955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:50.691431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:50.691943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:50.692378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:50.693068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:50.693520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:50.693942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:50.820185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:50.828193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-31c60b8b-0beb-40fc-818a-536cfb83c2f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.147641 Aug 22 19:23:50.828751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 351/681] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:50 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:50.906495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:50.907095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:50.914160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:50.914633 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:50.915064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:50.915775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:50.916228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:50.916641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:51.044074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:51.051598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f11fcb6f-ed05-465b-9850-bcd2b0bd6268 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.148974 Aug 22 19:23:51.052180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 331/682] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:50 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:51.850220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:51.850812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:51.857244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:51.857722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:51.858153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:51.858839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:51.859289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:51.859737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:51.994616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:52.003233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-519bf3af-2a83-4de2-b36f-bda60fcaa00a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.157642 Aug 22 19:23:52.003843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 352/683] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:51 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:52.072156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:52.072963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:52.079455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:52.079950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:52.080386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:52.081088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:52.081539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:52.081960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:52.098805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:52.217548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:52.226079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f73a99db-d4ba-4df6-93f6-09e03fd55bee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.157802 Aug 22 19:23:52.226639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 332/684] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:52 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:52.259608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:52.260236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:52.268621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:52.269141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:52.269578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:52.270314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:52.270764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:52.271188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:52.396981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lazy-loading 'services' on Instance uuid 2704afce-f4f6-491d-b146-17ed89f2b747 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:23:52.510431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cdb3b844-d776-4f00-a9ae-68a3f9e1d4cd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747/os-volume_attachments/78e22809-455f-4dac-ab48-283ecffe2f83" status: 202 len: 0 microversion: 2.1 time: 0.255891 Aug 22 19:23:52.511025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 353/685] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:23:52 2022] DELETE /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747/os-volume_attachments/78e22809-455f-4dac-ab48-283ecffe2f83 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:23:53.024497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:53.025133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:53.026992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=72 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:53.032301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:53.032774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:53.033204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:53.033884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:53.034330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:53.034746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:53.166637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:53.174981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f2369e3-ba2d-47cf-95d6-05df1fced10f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1708 microversion: 2.1 time: 0.154539 Aug 22 19:23:53.175544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 333/686] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:53.252545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:53.253296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:53.259374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:53.259886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:53.260323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:53.261020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:53.261470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:53.261893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:53.393550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:53.402025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2fef49f0-8490-4ff4-a2b7-75eb2afc76aa tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.157814 Aug 22 19:23:53.402605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 354/687] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:53 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:54.199323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:54.200166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:54.210771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:54.211634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:54.212400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:54.213118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:54.213578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:54.214199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:54.349940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:54.358284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-747022b6-11d7-4f7c-9cbb-a4da8abbbf32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1712 microversion: 2.1 time: 0.165078 Aug 22 19:23:54.358859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 334/688] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1712 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:54.423332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:54.423912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:54.430985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:54.431468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:54.431944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:54.432683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:54.433135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:54.433558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:54.479086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-806b315d-08ea-418e-a969-d4d5b0653f00 req-63009d0d-2cf2-4d58-8909-17ae06d39877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9698a0b1-a98a-40e1-9093-39946273a155", "name": "network-vif-plugged", "status": "completed", "tag": "23337ac5-214c-419d-b22b-ad62bd9b3776"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:54.491911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-806b315d-08ea-418e-a969-d4d5b0653f00 req-63009d0d-2cf2-4d58-8909-17ae06d39877 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:54.492581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-806b315d-08ea-418e-a969-d4d5b0653f00 req-63009d0d-2cf2-4d58-8909-17ae06d39877 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:54.493023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-806b315d-08ea-418e-a969-d4d5b0653f00 req-63009d0d-2cf2-4d58-8909-17ae06d39877 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:54.506645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-806b315d-08ea-418e-a969-d4d5b0653f00 req-63009d0d-2cf2-4d58-8909-17ae06d39877 service nova] Creating event network-vif-plugged:23337ac5-214c-419d-b22b-ad62bd9b3776 for instance 9698a0b1-a98a-40e1-9093-39946273a155 on hv-cinder-83538 Aug 22 19:23:54.512370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-806b315d-08ea-418e-a969-d4d5b0653f00 req-63009d0d-2cf2-4d58-8909-17ae06d39877 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038832 Aug 22 19:23:54.513174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 335/689] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:23:54.578372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:54.586367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-72b9a3c7-f437-47e0-b187-d699689e1ca0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.166934 Aug 22 19:23:54.599833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 355/690] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:54 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:54.698935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:54.699519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:54.705642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:54.706126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:54.706564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:54.707251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:54.707832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:54.708445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:54.734210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:23:54.812464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c29c78cb-0716-46a3-81ef-00c278566dd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 204 len: 0 microversion: 2.1 time: 0.117228 Aug 22 19:23:54.813471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 336/691] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:23:54 2022] DELETE /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:23:54.821686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:54.822297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:54.828150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:54.828622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:54.829055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:54.829734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:54.830187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:54.830611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:54.957022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:54.965144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6827b686-e282-4d04-bb54-f52ea9702120 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1513 microversion: 2.1 time: 0.147391 Aug 22 19:23:54.965712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 356/692] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:54 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:55.609257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:55.609886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:55.616773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:55.617268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:55.617683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:55.618362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:55.618807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:55.619223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:55.758023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:55.765867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a271ce20-76c4-4008-8907-ef0e83356f16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.161364 Aug 22 19:23:55.766431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 337/693] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:55 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:55.986319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:55.986932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:55.993973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:55.994452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:55.994883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:55.995570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:55.996045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:55.996468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:56.125227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:56.133273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0853e252-7e7a-400b-979c-a492c3416eba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1513 microversion: 2.1 time: 0.150806 Aug 22 19:23:56.133832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 357/694] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:55 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:56.787398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:56.788030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:56.794314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:56.794814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:56.795268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:56.795993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:56.796439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:56.796855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:56.924073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:56.932450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e403445f-5803-4a75-a019-31f5a6fc2256 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.149416 Aug 22 19:23:56.933014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 338/695] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:56 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:57.154262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:57.154876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:57.161959 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:57.162440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:57.162867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:57.163555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:57.164054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:57.164459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:57.292262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:57.299865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1afca9fd-dc42-4ac7-94fc-b3ea24e47abe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1513 microversion: 2.1 time: 0.149394 Aug 22 19:23:57.300435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 358/696] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:57 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:57.952700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:57.953426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:57.960080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:57.960563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:57.960997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:57.961696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:57.962215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:57.962639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:58.151116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:58.158646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-467d1540-e206-44ef-87e9-c0c85eb2a3bc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1359 microversion: 2.1 time: 0.209777 Aug 22 19:23:58.159444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 339/697] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:57 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:58.320754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:58.321476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:58.328727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:58.329221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:58.329657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:58.330358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:58.330809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:58.331233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:58.491173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:58.499721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f81cf690-626f-4e5a-a192-e87b48d82b0c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1513 microversion: 2.1 time: 0.182512 Aug 22 19:23:58.500031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 359/698] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:58 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:58.551473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e5dc8701-0e8f-4c04-b3b2-511adce94960 req-4cd11a8a-0df5-4df5-b1a3-ae3d9c32958f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2704afce-f4f6-491d-b146-17ed89f2b747", "name": "network-vif-deleted", "tag": "d4252c5b-98aa-47dd-a413-17ffc2a1197c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:23:58.560644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e5dc8701-0e8f-4c04-b3b2-511adce94960 req-4cd11a8a-0df5-4df5-b1a3-ae3d9c32958f service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:58.561116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e5dc8701-0e8f-4c04-b3b2-511adce94960 req-4cd11a8a-0df5-4df5-b1a3-ae3d9c32958f service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:58.561543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e5dc8701-0e8f-4c04-b3b2-511adce94960 req-4cd11a8a-0df5-4df5-b1a3-ae3d9c32958f service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:58.572178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e5dc8701-0e8f-4c04-b3b2-511adce94960 req-4cd11a8a-0df5-4df5-b1a3-ae3d9c32958f service nova] Creating event network-vif-deleted:d4252c5b-98aa-47dd-a413-17ffc2a1197c for instance 2704afce-f4f6-491d-b146-17ed89f2b747 on hv-cinder-83538 Aug 22 19:23:58.576963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e5dc8701-0e8f-4c04-b3b2-511adce94960 req-4cd11a8a-0df5-4df5-b1a3-ae3d9c32958f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083094 Aug 22 19:23:58.577528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 340/699] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:23:59.179702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:59.180318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:59.186156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.186636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.187069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.187788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.188261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.188682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.192687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:23:59.317505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:59.325584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-336c277c-4a3e-44e5-ae2c-922db95a7a81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1550 microversion: 2.1 time: 0.149695 Aug 22 19:23:59.326202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 360/700] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:59 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:59.346464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:59.347433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:59.353502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.353987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.354424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.355114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.355571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.356057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.489535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:59.498817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c45183df-33b9-4aeb-aa2c-7c3354f96f5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1550 microversion: 2.1 time: 0.156957 Aug 22 19:23:59.499416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 341/701] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:59 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:59.519626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:59.519899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:59.520390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:59.524518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:59.525295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Searching by: {'deleted': False, 'project_id': 'ec13a665e661424fa8602f7fbd962e16'} {{(pid=120639) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 19:23:59.527670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.528984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.529592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.530143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.530603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.531030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.532392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.532873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.533305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.534027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.534475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.535089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.566420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.567074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.567514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.568102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lazy-loading 'fault' on Instance uuid 2704afce-f4f6-491d-b146-17ed89f2b747 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:23:59.613077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:59.621766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e32349d-566d-4ad5-8871-22c6c225a6fe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 200 len: 1308 microversion: 2.1 time: 0.105925 Aug 22 19:23:59.623274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 342/702] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:59 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:23:59.629058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.multi_cell_list [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120639) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 19:23:59.727024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d3565c49-9ce0-451d-bcd2-2b5b4f316003 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208794 Aug 22 19:23:59.727539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 361/703] 10.222.0.61 () {58 vars in 1125 bytes} [Mon Aug 22 19:23:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:23:59.738581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:23:59.739181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:23:59.745622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.746094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.746522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.747198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:23:59.747656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:23:59.748075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:23:59.873651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:23:59.881250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-066b102c-4439-4878-bd2d-58dfc5d6124e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1550 microversion: 2.1 time: 0.146405 Aug 22 19:23:59.881800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 343/704] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:23:59 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:00.643740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:00.644354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 2704afce-f4f6-491d-b146-17ed89f2b747] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:00.651401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:00.651914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:00.652357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:00.653044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:00.653494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:00.653919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:00.666707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] HTTP exception thrown: Instance 2704afce-f4f6-491d-b146-17ed89f2b747 could not be found. Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Request method failure captured: Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 HTTP/1.1 Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9dlSpq0-pyeFPmh5ASmV5GrMo7tFhVWavh7rWYrq7NWCOVOBV_aIffmUE_yD2yos3RCOrL-zu0c3cZ_HnbNmqCoDxzUAF_LUjcWnD9XRTEMfLMYLrNcSYW6fuRdP06nAjQO7HuzGCFmEho8SlgrWT90nJvB4Mv5BLp4KS2fFbRCUig Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:24:00.668342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}] Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: aa9a0d600b1c42ec8fbb6710744bbd1d Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 2704afce-f4f6-491d-b146-17ed89f2b747 could not be found. Aug 22 19:24:00.669916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '2704afce-f4f6-491d-b146-17ed89f2b747'} Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2704afce-f4f6-491d-b146-17ed89f2b747 could not be found. Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:24:00.670983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2704afce-f4f6-491d-b146-17ed89f2b747 could not be found. Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2704afce-f4f6-491d-b146-17ed89f2b747 could not be found. Aug 22 19:24:00.672499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:24:00.673822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Returning 404 to user: Instance 2704afce-f4f6-491d-b146-17ed89f2b747 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:24:00.673822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f609e039-26eb-4e2d-b862-cf2d3bc95531 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747" status: 404 len: 111 microversion: 2.1 time: 0.029898 Aug 22 19:24:00.673822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 362/705] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:00 2022] GET /compute/v2.1/servers/2704afce-f4f6-491d-b146-17ed89f2b747 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:24:01.404011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73698f1c-5d7f-4892-a110-bc672c8c0275 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c73d1d5d-05f9-45c4-88b0-334566c488e3"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:24:01.406289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73698f1c-5d7f-4892-a110-bc672c8c0275 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:01.413075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73698f1c-5d7f-4892-a110-bc672c8c0275 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:01.413549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73698f1c-5d7f-4892-a110-bc672c8c0275 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:01.413978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73698f1c-5d7f-4892-a110-bc672c8c0275 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:01.414695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73698f1c-5d7f-4892-a110-bc672c8c0275 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:01.415146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73698f1c-5d7f-4892-a110-bc672c8c0275 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:01.415567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73698f1c-5d7f-4892-a110-bc672c8c0275 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:01.853569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73698f1c-5d7f-4892-a110-bc672c8c0275 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453337 Aug 22 19:24:01.854538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 344/706] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Aug 22 19:24:01 2022] POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:24:12.648626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1507408463", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "networks": [{"uuid": "99543fa1-797d-4736-ad9c-2245f1605915"}]}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:24:12.656717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:24:12.657374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=69 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:24:12.658002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=14 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:24:12.704249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] validate_networks() for [('99543fa1-797d-4736-ad9c-2245f1605915', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:24:13.085213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:24:13.085631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:24:13.086099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:24:13.086500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:24:13.086929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:24:13.095510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:13.096023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:13.096451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:13.097431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:13.097872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:13.098288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:13.115570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Getting quotas for project 44cc7501b8ad41cc93825b4480d7c3df. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:24:13.119521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Getting quotas for user aa9a0d600b1c42ec8fbb6710744bbd1d and project 44cc7501b8ad41cc93825b4480d7c3df. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:24:13.130252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:24:13.132528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:24:13.178248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9c35513d-0f14-4420-9fc9-e2946837935c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533466 Aug 22 19:24:13.178938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 363/707] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:24:13.187945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:24:13.188739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:24:13.192697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c971aec8-d7dc-44d1-95a2-811b2bc0f5ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:13.193439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c971aec8-d7dc-44d1-95a2-811b2bc0f5ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:13.253459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c971aec8-d7dc-44d1-95a2-811b2bc0f5ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:13.260245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c971aec8-d7dc-44d1-95a2-811b2bc0f5ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1219 microversion: 2.1 time: 0.074028 Aug 22 19:24:13.260924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 345/708] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:13 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:13.651614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:13.652360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:13.660221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:13.660920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:13.661384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:13.662329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:13.662902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:13.663344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:13.796306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:13.805362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-52db2cb1-abd7-4d9f-9ac1-3966430a24a8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1596 microversion: 2.1 time: 0.157764 Aug 22 19:24:13.805892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 364/709] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1596 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:14.281094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:14.282375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:14.290116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:14.290623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:14.291050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:14.291780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:14.292235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:14.292654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:14.372004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:14.379562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c649b938-7fa8-4be0-b2d5-2c5eb72a263b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1271 microversion: 2.1 time: 0.102932 Aug 22 19:24:14.380235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 346/710] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:14 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:15.402044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:15.404804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:15.413839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:15.414761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:15.415421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:15.417858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:15.418697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:15.419368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:15.464214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-11c57375-fd9c-4789-9681-55e05ebc38b8 req-a4dcab56-332c-4ac0-ba0f-bc1c1de25c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9698a0b1-a98a-40e1-9093-39946273a155", "tag": "23337ac5-214c-419d-b22b-ad62bd9b3776"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:24:15.478760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-11c57375-fd9c-4789-9681-55e05ebc38b8 req-a4dcab56-332c-4ac0-ba0f-bc1c1de25c85 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:15.479596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-11c57375-fd9c-4789-9681-55e05ebc38b8 req-a4dcab56-332c-4ac0-ba0f-bc1c1de25c85 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:15.480267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-11c57375-fd9c-4789-9681-55e05ebc38b8 req-a4dcab56-332c-4ac0-ba0f-bc1c1de25c85 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:15.492855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-11c57375-fd9c-4789-9681-55e05ebc38b8 req-a4dcab56-332c-4ac0-ba0f-bc1c1de25c85 service nova] Creating event network-changed:23337ac5-214c-419d-b22b-ad62bd9b3776 for instance 9698a0b1-a98a-40e1-9093-39946273a155 on hv-cinder-83538 Aug 22 19:24:15.499123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-11c57375-fd9c-4789-9681-55e05ebc38b8 req-a4dcab56-332c-4ac0-ba0f-bc1c1de25c85 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040393 Aug 22 19:24:15.500518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 347/711] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:24:15.623356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:15.632126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c00ff437-dd46-49b7-8f79-e671884c7a87 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.234999 Aug 22 19:24:15.647211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 365/712] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:15 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:16.083884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-fa46a34c-0d7f-42e1-80e4-9bcce6e7d41c req-c8c4ca25-1c5b-4dd8-9086-90405ff32ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b81f37d-80e6-429a-9afd-79fccb869bde", "tag": "2a89284f-51ed-4cd5-9e85-4de6ce81e9ac"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:24:16.097347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fa46a34c-0d7f-42e1-80e4-9bcce6e7d41c req-c8c4ca25-1c5b-4dd8-9086-90405ff32ec7 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:16.098286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fa46a34c-0d7f-42e1-80e4-9bcce6e7d41c req-c8c4ca25-1c5b-4dd8-9086-90405ff32ec7 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:16.099451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fa46a34c-0d7f-42e1-80e4-9bcce6e7d41c req-c8c4ca25-1c5b-4dd8-9086-90405ff32ec7 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:16.111708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-fa46a34c-0d7f-42e1-80e4-9bcce6e7d41c req-c8c4ca25-1c5b-4dd8-9086-90405ff32ec7 service nova] Creating event network-changed:2a89284f-51ed-4cd5-9e85-4de6ce81e9ac for instance 0b81f37d-80e6-429a-9afd-79fccb869bde on hv-cinder-83538 Aug 22 19:24:16.117837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-fa46a34c-0d7f-42e1-80e4-9bcce6e7d41c req-c8c4ca25-1c5b-4dd8-9086-90405ff32ec7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065338 Aug 22 19:24:16.119109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 348/713] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:24:16.653017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:16.654194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:16.664138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:16.665265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:16.665927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:16.667262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:16.667951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:16.668643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:16.868338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:16.878510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f4ab8a9b-5d00-44df-93b3-20891c929ae0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.229199 Aug 22 19:24:16.879083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 366/714] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:16 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:16.891500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1158997264"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:24:16.892746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:16.898976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:16.899468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:16.899930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:16.900628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:16.901077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:16.901502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:17.031494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.network.security_group_api [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Adding security group 2c406cf5-f685-4b77-aae9-993b9bb015f7 to port 23337ac5-214c-419d-b22b-ad62bd9b3776 Aug 22 19:24:17.339046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29515701-154f-4869-821c-de47d9016579 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/action" status: 202 len: 0 microversion: 2.1 time: 0.451795 Aug 22 19:24:17.339663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 349/715] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:24:16 2022] POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:24:17.348351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:17.349587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:17.355477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:17.355995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:17.356428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:17.357120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:17.357566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:17.357990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:17.506313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:17.514686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2a62ae86-717f-4f69-8aca-d98ead4df9b5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1762 microversion: 2.1 time: 0.170443 Aug 22 19:24:17.515245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 367/716] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1762 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:17.898882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:17.899498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:17.905416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:17.905900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:17.906381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:17.907030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:17.907476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:17.908562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:18.037319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:18.044899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2918e61-6a0e-4b21-a640-260a39efcdb2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.150449 Aug 22 19:24:18.045467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 350/717] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:17 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:18.153018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-43f05f7a-37ca-4f4d-8ea2-0cd328fae91e req-c068360e-53d0-409d-b699-250b1d271a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9698a0b1-a98a-40e1-9093-39946273a155", "tag": "23337ac5-214c-419d-b22b-ad62bd9b3776"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:24:18.163267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-43f05f7a-37ca-4f4d-8ea2-0cd328fae91e req-c068360e-53d0-409d-b699-250b1d271a33 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:18.163702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-43f05f7a-37ca-4f4d-8ea2-0cd328fae91e req-c068360e-53d0-409d-b699-250b1d271a33 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:18.164126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-43f05f7a-37ca-4f4d-8ea2-0cd328fae91e req-c068360e-53d0-409d-b699-250b1d271a33 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:18.174402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-43f05f7a-37ca-4f4d-8ea2-0cd328fae91e req-c068360e-53d0-409d-b699-250b1d271a33 service nova] Creating event network-changed:23337ac5-214c-419d-b22b-ad62bd9b3776 for instance 9698a0b1-a98a-40e1-9093-39946273a155 on hv-cinder-83538 Aug 22 19:24:18.179768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-43f05f7a-37ca-4f4d-8ea2-0cd328fae91e req-c068360e-53d0-409d-b699-250b1d271a33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030126 Aug 22 19:24:18.180321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 368/718] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:24:19.065167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:19.065735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:19.072688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:19.073168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:19.073605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:19.074296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:19.074748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:19.075167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:19.204711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:19.212291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e796c27d-0e9e-4315-8a4c-532c6cd3fd79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.151086 Aug 22 19:24:19.212852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 351/719] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:19 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:20.234032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:20.234726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:20.241893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:20.242368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:20.242804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:20.243482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:20.243976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:20.244395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:20.374473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:20.382188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f05392bb-d465-4b0d-bdc9-0b67106d8f10 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.152295 Aug 22 19:24:20.382751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 369/720] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:20 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:21.402944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:21.403575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:21.410088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:21.410645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:21.411172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:21.411901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:21.412358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:21.412784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:21.548008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:21.556199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2bf26f5e-8878-4778-9611-67ab7ea51a32 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.157228 Aug 22 19:24:21.556775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 352/721] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:21 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:22.577179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:22.577783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:22.584665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:22.585142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:22.585571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:22.586256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:22.586699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:22.587117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:22.712575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:22.720054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8a28d194-1f4f-4c1b-83db-170cae799789 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.146668 Aug 22 19:24:22.720608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 370/722] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:22 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:23.742356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:23.742963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:23.745768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:24:23.751320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:23.751828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:23.752257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:23.752943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:23.753425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:23.753836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:23.774913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:24:23.775866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=6 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:24:23.834884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-4223057c-5d7b-45fd-94a3-5e413349330e req-e4c8758f-b0f4-472f-b917-e8470d1e2b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b81f37d-80e6-429a-9afd-79fccb869bde", "name": "network-vif-plugged", "status": "completed", "tag": "2a89284f-51ed-4cd5-9e85-4de6ce81e9ac"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:24:23.844813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-4223057c-5d7b-45fd-94a3-5e413349330e req-e4c8758f-b0f4-472f-b917-e8470d1e2b46 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:23.845484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-4223057c-5d7b-45fd-94a3-5e413349330e req-e4c8758f-b0f4-472f-b917-e8470d1e2b46 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:23.846064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-4223057c-5d7b-45fd-94a3-5e413349330e req-e4c8758f-b0f4-472f-b917-e8470d1e2b46 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:23.858147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-4223057c-5d7b-45fd-94a3-5e413349330e req-e4c8758f-b0f4-472f-b917-e8470d1e2b46 service nova] Creating event network-vif-plugged:2a89284f-51ed-4cd5-9e85-4de6ce81e9ac for instance 0b81f37d-80e6-429a-9afd-79fccb869bde on hv-cinder-83538 Aug 22 19:24:23.865084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-4223057c-5d7b-45fd-94a3-5e413349330e req-e4c8758f-b0f4-472f-b917-e8470d1e2b46 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093925 Aug 22 19:24:23.866106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 371/723] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:24:23.894220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:23.901861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1592ec89-7643-4b1c-a0d7-e686ece964e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.164081 Aug 22 19:24:23.902414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 353/724] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:23 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:24.922792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:24.923414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:24.929628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:24.930109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:24.930546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:24.931229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:24.931715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:24.932140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:25.091593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:25.101684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ca698e08-cfe4-4f66-a683-8aa28dc50e2c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.183474 Aug 22 19:24:25.102257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 372/725] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:24 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:26.124765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:26.125288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:26.131793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:26.132276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:26.132712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:26.133404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:26.133853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:26.134276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:26.264471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:26.272483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0bf80d8-55da-48e9-8a1d-a0d542c54e86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.151649 Aug 22 19:24:26.273044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 354/726] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:26 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:27.293201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:27.293784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:27.300196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:27.300671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:27.301094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:27.301770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:27.302257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:27.302672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:27.427540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:27.434955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e2bdc432-de99-4581-8e98-6cb61954689e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1319 microversion: 2.1 time: 0.145542 Aug 22 19:24:27.435507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 373/727] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:27 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:28.455662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:24:28.456257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:28.462546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:28.463021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:28.463449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:28.464164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:28.464606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:28.465019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:28.591661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:24:28.600496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c086507-ddb2-4947-8c4d-2de290d07501 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1508 microversion: 2.1 time: 0.148562 Aug 22 19:24:28.601054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 355/728] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:24:28 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:24:28.620405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c110adb5-bcfc-42b8-812e-6e4b65164cc8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ad044e8-196a-4891-bcb2-cd0fa229093d", "device": "/dev/sdb"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:24:28.622817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c110adb5-bcfc-42b8-812e-6e4b65164cc8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:28.629174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c110adb5-bcfc-42b8-812e-6e4b65164cc8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:28.629658 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c110adb5-bcfc-42b8-812e-6e4b65164cc8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:28.630091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c110adb5-bcfc-42b8-812e-6e4b65164cc8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:28.630779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c110adb5-bcfc-42b8-812e-6e4b65164cc8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:28.631232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c110adb5-bcfc-42b8-812e-6e4b65164cc8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:28.631699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c110adb5-bcfc-42b8-812e-6e4b65164cc8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:28.900421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c110adb5-bcfc-42b8-812e-6e4b65164cc8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "POST /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283755 Aug 22 19:24:28.903948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 374/729] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Aug 22 19:24:28 2022] POST /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:24:36.619621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51a88129-33ad-4d3e-b7c3-fef7cfb89a50 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb79d8da-4f31-4277-89a4-336e11f55658"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:24:36.622031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51a88129-33ad-4d3e-b7c3-fef7cfb89a50 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:24:36.627996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51a88129-33ad-4d3e-b7c3-fef7cfb89a50 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:36.628494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51a88129-33ad-4d3e-b7c3-fef7cfb89a50 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:36.628908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51a88129-33ad-4d3e-b7c3-fef7cfb89a50 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:36.629594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51a88129-33ad-4d3e-b7c3-fef7cfb89a50 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:24:36.630047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51a88129-33ad-4d3e-b7c3-fef7cfb89a50 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:24:36.630470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51a88129-33ad-4d3e-b7c3-fef7cfb89a50 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:24:36.940805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51a88129-33ad-4d3e-b7c3-fef7cfb89a50 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426765 Aug 22 19:24:36.941331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 356/730] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Aug 22 19:24:36 2022] POST /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:25:24.610934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:25:24.611759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:25:24.616619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:24.617188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:24.624618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:24.625100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:24.625534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:24.626222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:24.626670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:24.627089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:24.706733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lazy-loading 'services' on Instance uuid 604c6a93-ddc1-4f33-81a5-f431e35b16a8 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:25:24.775726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cbc947fc-8d1c-4402-8407-03f6a27e46d8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "DELETE /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments/0b028411-fbd8-417e-81b0-0d0de051be64" status: 202 len: 0 microversion: 2.1 time: 0.166056 Aug 22 19:25:24.776305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 375/731] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:25:24 2022] DELETE /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments/0b028411-fbd8-417e-81b0-0d0de051be64 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:25:40.384773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=26 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:25:40.385521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:25:40.390155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:25:40.392424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:40.399554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:40.400001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:40.400431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:40.401120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:40.401566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:40.401985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:40.424646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'flavor' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:25:40.579181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a995a8e8-a243-470a-8b7c-634546234241 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/action" status: 200 len: 32 microversion: 2.1 time: 0.196163 Aug 22 19:25:40.579804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 357/732] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:25:40 2022] POST /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 19:25:40.587558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:25:40.588520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:25:40.592622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:40.593396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:40.601693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:40.602183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:40.602617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:40.603323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:40.603815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:40.604335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:40.742205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:40.750596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-97bbd364-fc2c-4616-9f9d-aa5e168852dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.164619 Aug 22 19:25:40.751161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 376/733] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:41.772827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:41.773530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:41.780347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:41.780834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:41.781284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:41.781975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:41.782428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:41.782853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:41.910544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:41.931324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb677305-3d26-4198-bef8-f53d211a6c1c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.163017 Aug 22 19:25:41.932257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 358/734] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:25:42.952421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:42.953046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:42.959383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:42.960395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:42.960831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:42.961516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:42.961966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:42.962391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:43.089801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:43.098094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7af1eddf-db4c-48dd-ba73-40123073d7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149516 Aug 22 19:25:43.098650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 377/735] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:44.118828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:44.119388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:44.126140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:44.126656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:44.127092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:44.127827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:44.128289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:44.128710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:44.260102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:44.268308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c994720-230e-4589-94c6-640f6e3d8746 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153468 Aug 22 19:25:44.268864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 359/736] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:45.289118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:45.289722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:45.296093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:45.296575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:45.297013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:45.297700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:45.298149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:45.298568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:45.427353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:45.435915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-aed8f15c-e2df-4674-a4d1-d74e4c2be109 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151129 Aug 22 19:25:45.436625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 378/737] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:46.456907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:46.457515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:46.464244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:46.464728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:46.465164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:46.465855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:46.466306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:46.466727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:46.592548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:46.600837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f380503-c2b8-411a-8b49-823be544a248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147759 Aug 22 19:25:46.601406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 360/738] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:47.621922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:47.622463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:47.629155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:47.629631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:47.630060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:47.630741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:47.631189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:47.632219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:47.761603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:47.769717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-13f02426-c395-450f-8704-0376d3e803d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151665 Aug 22 19:25:47.770272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 379/739] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:48.790739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:48.791328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:48.797736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:48.798216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:48.798651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:48.799337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:48.799820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:48.800241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:48.930333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:48.938414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8fe6c1c2-50da-4bec-9c0c-f373ec5a90de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151576 Aug 22 19:25:48.938977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 361/740] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:49.960017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:49.960629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:49.967751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:49.968239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:49.968672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:49.969362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:49.969826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:49.970243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:50.096131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:50.104494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8029714a-cbd4-4d90-814e-1d43f92d69d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148246 Aug 22 19:25:50.105061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 380/741] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:51.126058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:51.126665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:51.133200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:51.133684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:51.134124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:51.134811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:51.135939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:51.136376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:51.267830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:51.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd29a446-72ef-4025-a94a-42b957f0017b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153674 Aug 22 19:25:51.276462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 362/742] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:25:52.297088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:52.297699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:52.304106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:52.304587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:52.305026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:52.305711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:52.306160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:52.306579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:52.434484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:52.442632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1c923a8e-6b39-481a-9409-8f109ece7be2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149263 Aug 22 19:25:52.443188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 381/743] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:53.464044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:53.464658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:53.470987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:53.471468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:53.472201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:53.472889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:53.473345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:53.473772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:53.601682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:53.611020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef9751f3-3fe2-4c0c-8462-164bc93a3c54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150960 Aug 22 19:25:53.611574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 363/744] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:54.632423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:54.633037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:54.639441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:54.639958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:54.640390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:54.641277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:54.641769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:54.642196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:54.766815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:54.774846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-298a1ec4-3104-4bdb-9147-8621a325f8a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.146255 Aug 22 19:25:54.775413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 382/745] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:55.796473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:55.797078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:55.803314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:55.803825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:55.804255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:55.804934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:55.805374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:55.805791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:55.935221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:55.943215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-857a6c9a-8c11-4f90-b144-669b0be69704 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150627 Aug 22 19:25:55.943789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 364/746] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:56.964579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:56.965187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:56.971445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:56.972217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:56.972653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:56.973336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:56.973788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:56.974210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:57.097253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:57.105952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f153eeee-a611-47b6-9010-fcc24f27746b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.145744 Aug 22 19:25:57.106514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 383/747] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:57.315013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c132bc9-ff94-4a14-aaaf-f1374ae623aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:57.315539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c132bc9-ff94-4a14-aaaf-f1374ae623aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:57.321915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c132bc9-ff94-4a14-aaaf-f1374ae623aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:57.322397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c132bc9-ff94-4a14-aaaf-f1374ae623aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:57.322838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c132bc9-ff94-4a14-aaaf-f1374ae623aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:57.323527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c132bc9-ff94-4a14-aaaf-f1374ae623aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:57.324000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c132bc9-ff94-4a14-aaaf-f1374ae623aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:57.324423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c132bc9-ff94-4a14-aaaf-f1374ae623aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:57.346319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c132bc9-ff94-4a14-aaaf-f1374ae623aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa/ips" status: 200 len: 150 microversion: 2.1 time: 0.035149 Aug 22 19:25:57.347124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 365/748] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:25:57 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:25:57.358787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52c61c72-7da4-4bd8-b4b7-114b53fdb0f8"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:25:57.361272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:57.367162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:57.367635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:57.368098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:57.368780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:57.369229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:57.370250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:57.446493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Invalid volume: volume 52c61c72-7da4-4bd8-b4b7-114b53fdb0f8 is already attached to instances: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: POST /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa/os-volume_attachments HTTP/1.1 Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 74 Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:25:57.448241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {"volumeAttachment": {"volumeId": "52c61c72-7da4-4bd8-b4b7-114b53fdb0f8"}} Aug 22 19:25:57.449968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Invalid volume: volume 52c61c72-7da4-4bd8-b4b7-114b53fdb0f8 is already attached to instances: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': '8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa', 'body': {'volumeAttachment': {'volumeId': '52c61c72-7da4-4bd8-b4b7-114b53fdb0f8'}}} Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 52c61c72-7da4-4bd8-b4b7-114b53fdb0f8 is already attached to instances: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:25:57.450879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 52c61c72-7da4-4bd8-b4b7-114b53fdb0f8 is already attached to instances: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:25:57.452325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:25:57.453779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:25:57.453779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:25:57.453779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:25:57.453779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 52c61c72-7da4-4bd8-b4b7-114b53fdb0f8 is already attached to instances: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e Aug 22 19:25:57.453779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:25:57.453779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 400 to user: Invalid volume: volume 52c61c72-7da4-4bd8-b4b7-114b53fdb0f8 is already attached to instances: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:25:57.453779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d75b6364-5650-455f-bd5f-5667162034e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094890 Aug 22 19:25:57.453779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 384/749] 10.222.0.61 () {60 vars in 1323 bytes} [Mon Aug 22 19:25:57 2022] POST /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:25:57.458440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:57.458934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:57.464816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:57.465240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:57.465676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:57.466359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:57.466809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:57.467232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:57.491487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:25:57.572133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd18df5f-7b6d-446b-90bf-11bbb14b3f36 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 204 len: 0 microversion: 2.1 time: 0.117139 Aug 22 19:25:57.577112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 366/750] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:25:57 2022] DELETE /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:25:57.584964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:57.585578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:57.592745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:57.593228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:57.593665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:57.594359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:57.594816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:57.595243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:57.734119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:57.741693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bf32c3a7-51cf-4f41-92b9-725c6a8208fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1682 microversion: 2.1 time: 0.160553 Aug 22 19:25:57.742257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 385/751] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:57 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:58.127200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:58.127843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:58.134044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:58.134535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:58.134975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:58.136281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:58.137203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:58.137203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:58.264739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:58.272756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e602440f-57d5-4dbd-b402-4fe7cb3a1f11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149838 Aug 22 19:25:58.273309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 367/752] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:58.765249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:58.765879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:58.772134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:58.772610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:58.773036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:58.773713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:58.774161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:58.774577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:58.863166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f58f3217-7d5c-48b0-8eae-9007df481687 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:25:58.865591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f58f3217-7d5c-48b0-8eae-9007df481687 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:58.871460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f58f3217-7d5c-48b0-8eae-9007df481687 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:58.872038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f58f3217-7d5c-48b0-8eae-9007df481687 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:58.872559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f58f3217-7d5c-48b0-8eae-9007df481687 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:58.873258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f58f3217-7d5c-48b0-8eae-9007df481687 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:58.873707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f58f3217-7d5c-48b0-8eae-9007df481687 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:58.874124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f58f3217-7d5c-48b0-8eae-9007df481687 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:58.904542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:58.912056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a6bec303-b84c-4ca1-80e3-638cb4824c08 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1682 microversion: 2.1 time: 0.150524 Aug 22 19:25:58.912820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 386/753] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:58 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:58.941984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f58f3217-7d5c-48b0-8eae-9007df481687 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/action" status: 202 len: 0 microversion: 2.1 time: 0.082501 Aug 22 19:25:58.942591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 368/754] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:25:58 2022] POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 19:25:58.951365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:58.952014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:58.957984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:58.958459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:58.958887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:58.959571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:58.960041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:58.960478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:59.108737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:59.117101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3335c18d-6ff8-4044-bfde-a69bf3d92d7f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1754 microversion: 2.1 time: 0.169924 Aug 22 19:25:59.117858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 387/755] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:58 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:59.295883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:59.296714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:59.302903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:59.303388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:59.303854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:59.304540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:59.304988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:59.305406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:59.309490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:25:59.485368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:25:59.493473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9527a502-0847-4ff5-897a-16e84424ffd8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.202939 Aug 22 19:25:59.494039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 369/756] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:25:59.934072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:25:59.934686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:25:59.941019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:59.941495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:59.941927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:25:59.942614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:25:59.943063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:25:59.943489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:00.072138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:00.080522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6e88bf1e-7769-4029-b5a2-44a8112bb124 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1682 microversion: 2.1 time: 0.150840 Aug 22 19:26:00.081097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 388/757] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:25:59 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:00.138832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:00.139435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:00.146254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:00.146904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:00.147350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:00.148091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:00.148602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:00.149047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:00.355495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:00.364235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b8fb1b2-e8d7-4894-9bea-fa88e8cd40e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.229828 Aug 22 19:26:00.364805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 370/758] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:00 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:00.514796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:00.515463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:00.521322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:00.521801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:00.522234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:00.522921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:00.523395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:00.523848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:00.656616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:00.665284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eee1ca84-2a52-423a-bb95-ca55ee7e5693 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154898 Aug 22 19:26:00.665863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 389/759] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:01.102163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7c47bfc8-ccac-417d-a5b2-8c7dd8740d56 req-6c3020a9-bff0-4d1f-b23a-d9acac9b6a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa", "name": "network-vif-deleted", "tag": "31f49ec4-55fd-4cfa-bb24-b2fed1afff8b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:26:01.102683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:01.103379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:01.112386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:01.112386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:01.112386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:01.112386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:01.112859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:01.112859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:01.118891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7c47bfc8-ccac-417d-a5b2-8c7dd8740d56 req-6c3020a9-bff0-4d1f-b23a-d9acac9b6a0c service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:01.119416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7c47bfc8-ccac-417d-a5b2-8c7dd8740d56 req-6c3020a9-bff0-4d1f-b23a-d9acac9b6a0c service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:01.119887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7c47bfc8-ccac-417d-a5b2-8c7dd8740d56 req-6c3020a9-bff0-4d1f-b23a-d9acac9b6a0c service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:01.144323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7c47bfc8-ccac-417d-a5b2-8c7dd8740d56 req-6c3020a9-bff0-4d1f-b23a-d9acac9b6a0c service nova] Creating event network-vif-deleted:31f49ec4-55fd-4cfa-bb24-b2fed1afff8b for instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa on hv-cinder-83538 Aug 22 19:26:01.156783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7c47bfc8-ccac-417d-a5b2-8c7dd8740d56 req-6c3020a9-bff0-4d1f-b23a-d9acac9b6a0c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058187 Aug 22 19:26:01.158015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 371/760] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:01.214932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:01.226691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-86c95e66-34de-4206-b122-e6b28105998d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 200 len: 1614 microversion: 2.1 time: 0.127987 Aug 22 19:26:01.229181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 390/761] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:01 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 1614 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:01.386033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:01.386641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:01.392906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:01.393391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:01.393827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:01.394527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:01.394977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:01.395403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:01.550182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:01.558936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b56dcec0-bd34-4ef9-99e0-0fe652a72a32 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.177779 Aug 22 19:26:01.559593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 372/762] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:01 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:01.686427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:01.687217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:01.693340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:01.694077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:01.694582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:01.695352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:01.695904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:01.696398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:01.833745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:01.850495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-38182ebc-1fcc-4999-a5ea-f51a8defeee8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.167204 Aug 22 19:26:01.852530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 391/763] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:02.249481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:02.250128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:02.256036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:02.256517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:02.256977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:02.257646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:02.258096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:02.258515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:02.272400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa HTTP/1.1 Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:26:02.274134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:26:02.275902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa'} Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:26:02.276830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:26:02.278339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:26:02.279830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:26:02.279830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8454e87-2a7e-43c7-95cf-adb1882d6c44 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 404 len: 111 microversion: 2.1 time: 0.029971 Aug 22 19:26:02.279830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 373/764] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:02 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:26:02.284315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a5912d0d-1594-4d43-829f-fda2cea6c28b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '.version_select at 0x7f66e7df0f70>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:02.289265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5912d0d-1594-4d43-829f-fda2cea6c28b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [e57f4476-3d85-40a7-8a39-01a857abb850] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 19:26:02.580391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:02.581005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:02.587350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:02.587876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:02.588889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:02.589581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:02.590031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:02.590456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:02.733650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:02.741736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-317b2866-aac2-48e1-8f18-b437be2b70a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.165213 Aug 22 19:26:02.742295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 374/765] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:02 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:02.874479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:02.875097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:02.880880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:02.881361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:02.881792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:02.882493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:02.882933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:02.883360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:03.013802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:03.022331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90109136-27e4-4414-a36d-1657f79e09a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151586 Aug 22 19:26:03.022903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 375/766] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:03.297079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5912d0d-1594-4d43-829f-fda2cea6c28b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [e57f4476-3d85-40a7-8a39-01a857abb850] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 38634. Aug 22 19:26:03.315870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a5912d0d-1594-4d43-829f-fda2cea6c28b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956240254" status: 202 len: 0 microversion: 2.1 time: 1.035266 Aug 22 19:26:03.316450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 392/767] 10.222.0.61 () {58 vars in 1221 bytes} [Mon Aug 22 19:26:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956240254 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:26:03.763246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:03.763908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:03.770215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:03.770700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:03.771135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:03.771876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:03.772328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:03.772752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:03.972377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:03.980453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47ea9d8b-3757-40aa-96e2-dce1fc4e052f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.221034 Aug 22 19:26:03.981019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 376/768] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:03 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:04.007447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:04.007831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:04.015566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:04.016089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:04.016529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:04.017230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:04.017686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:04.018139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:04.035416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:04.043220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:04.043853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:04.049698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:04.050175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:04.050605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:04.051288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:04.051761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:04.052181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:04.099731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lazy-loading 'services' on Instance uuid 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:26:04.173364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3622c2dc-c62f-4e59-9f11-a1596efadead tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments/52c61c72-7da4-4bd8-b4b7-114b53fdb0f8" status: 202 len: 0 microversion: 2.1 time: 0.170211 Aug 22 19:26:04.173950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 393/769] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:26:04 2022] DELETE /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments/52c61c72-7da4-4bd8-b4b7-114b53fdb0f8 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:26:04.182878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b041c75a-caa9-451f-8472-7b7e0f5e865f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:04.185218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b041c75a-caa9-451f-8472-7b7e0f5e865f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:04.191137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:04.191675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b041c75a-caa9-451f-8472-7b7e0f5e865f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:04.192189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b041c75a-caa9-451f-8472-7b7e0f5e865f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:04.192625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b041c75a-caa9-451f-8472-7b7e0f5e865f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:04.193318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b041c75a-caa9-451f-8472-7b7e0f5e865f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:04.193764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b041c75a-caa9-451f-8472-7b7e0f5e865f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:04.194235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b041c75a-caa9-451f-8472-7b7e0f5e865f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:04.200077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87caf139-2b57-42e8-bbd3-dd7f8785fe75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.160485 Aug 22 19:26:04.201339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 377/770] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:04.224394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b041c75a-caa9-451f-8472-7b7e0f5e865f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Aug 22 19:26:04.224934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 394/771] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:04 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:05.001273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:05.001918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:05.008229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:05.008715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:05.009152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:05.009845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:05.010297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:05.010718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:05.147472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:05.156056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-100a97d3-0861-48a6-a531-4c8f5a277717 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.158484 Aug 22 19:26:05.156613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 378/772] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:04 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:05.222348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:05.223107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:05.229248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:05.230322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:05.230753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:05.231438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:05.231906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:05.232322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:05.236935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e1ab845-19f4-4ce7-b917-1edcc0453b70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:05.239220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e1ab845-19f4-4ce7-b917-1edcc0453b70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:05.245305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1ab845-19f4-4ce7-b917-1edcc0453b70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:05.245717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1ab845-19f4-4ce7-b917-1edcc0453b70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:05.246146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1ab845-19f4-4ce7-b917-1edcc0453b70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:05.246836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1ab845-19f4-4ce7-b917-1edcc0453b70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:05.247313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1ab845-19f4-4ce7-b917-1edcc0453b70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:05.247758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1ab845-19f4-4ce7-b917-1edcc0453b70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:05.278151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e1ab845-19f4-4ce7-b917-1edcc0453b70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Aug 22 19:26:05.278717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 379/773] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:05 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:26:05.361078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:05.369146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fba4d53f-5ad5-42c1-882a-58cbef521be7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150845 Aug 22 19:26:05.369706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 395/774] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:06.177625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:06.178238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:06.185243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:06.185727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:06.186161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:06.186860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:06.187308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:06.187765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:06.290422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8c413fd8-ff58-474a-9bd8-86b3c11c4853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:06.293483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8c413fd8-ff58-474a-9bd8-86b3c11c4853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:06.299860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c413fd8-ff58-474a-9bd8-86b3c11c4853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:06.300344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c413fd8-ff58-474a-9bd8-86b3c11c4853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:06.300779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c413fd8-ff58-474a-9bd8-86b3c11c4853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:06.301485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c413fd8-ff58-474a-9bd8-86b3c11c4853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:06.301938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c413fd8-ff58-474a-9bd8-86b3c11c4853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:06.302363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c413fd8-ff58-474a-9bd8-86b3c11c4853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:06.328438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:06.331480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8c413fd8-ff58-474a-9bd8-86b3c11c4853 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044995 Aug 22 19:26:06.332084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 396/775] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:06 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:26:06.340613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3726ef0-802b-437e-b365-e23bd4b31b7b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.166783 Aug 22 19:26:06.341152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 380/776] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:06 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:06.389149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:06.389794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:06.395743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:06.396231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:06.396672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:06.397358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:06.397811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:06.398237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:06.527726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:06.535923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-296c0498-3b94-4eff-b3f0-55c403b2ad4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150552 Aug 22 19:26:06.536497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 397/777] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:07.344183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b585434-d853-4138-9582-54a9c5fff633 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:07.346402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b585434-d853-4138-9582-54a9c5fff633 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:07.353020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b585434-d853-4138-9582-54a9c5fff633 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.353498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b585434-d853-4138-9582-54a9c5fff633 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.353936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b585434-d853-4138-9582-54a9c5fff633 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.354682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b585434-d853-4138-9582-54a9c5fff633 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.355725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b585434-d853-4138-9582-54a9c5fff633 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.356148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b585434-d853-4138-9582-54a9c5fff633 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.361905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:07.362511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:07.368805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.369284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.369719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.370405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.370884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.371305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.385059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b585434-d853-4138-9582-54a9c5fff633 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Aug 22 19:26:07.385665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 381/778] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:07 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:07.508467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:07.516496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-04239161-8fad-469d-817e-f39fcf5e540f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.158620 Aug 22 19:26:07.517052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 398/779] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:07 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:07.556418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:07.557029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:07.563148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.563631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.564101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.564791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.565240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.565660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.696204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:07.704438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9eee1e3-c4a1-48a1-b5e9-5e46b43fbe2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1716 microversion: 2.1 time: 0.151758 Aug 22 19:26:07.705004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 382/780] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:07.764424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:07.764924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:07.770863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.771352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.771826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.772516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.772969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.773393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.835020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:07.835789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:07.841790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.842281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.842716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.843420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.843906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.844338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.854983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Cannot 'detach_volume' instance f6744e43-5389-4422-9030-dfdf1b522dcc while it is in vm_state rescued Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 HTTP/1.1 Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:26:07.856621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:26:07.858238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Cannot 'detach_volume' instance f6744e43-5389-4422-9030-dfdf1b522dcc while it is in vm_state rescued Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': 'f6744e43-5389-4422-9030-dfdf1b522dcc', 'id': 'eb79d8da-4f31-4277-89a4-336e11f55658'} Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f6744e43-5389-4422-9030-dfdf1b522dcc in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:26:07.859142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f6744e43-5389-4422-9030-dfdf1b522dcc while it is in vm_state rescued Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f6744e43-5389-4422-9030-dfdf1b522dcc while it is in vm_state rescued Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:26:07.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 409 to user: Cannot 'detach_volume' instance f6744e43-5389-4422-9030-dfdf1b522dcc while it is in vm_state rescued {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:26:07.862015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-da3e3359-f5d9-4cdb-bde9-e151043efad0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 409 len: 152 microversion: 2.1 time: 0.097692 Aug 22 19:26:07.862015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 399/781] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:26:07 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 22 19:26:07.866515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c29670c9-8753-4201-8f7a-c74d17b17d8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:26:07.867034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c29670c9-8753-4201-8f7a-c74d17b17d8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:07.873353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:26:07.873505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c29670c9-8753-4201-8f7a-c74d17b17d8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.873894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c29670c9-8753-4201-8f7a-c74d17b17d8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.874331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c29670c9-8753-4201-8f7a-c74d17b17d8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.875024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c29670c9-8753-4201-8f7a-c74d17b17d8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.875505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c29670c9-8753-4201-8f7a-c74d17b17d8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.875967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c29670c9-8753-4201-8f7a-c74d17b17d8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.944495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c29670c9-8753-4201-8f7a-c74d17b17d8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/action" status: 202 len: 0 microversion: 2.1 time: 0.081345 Aug 22 19:26:07.945729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 400/782] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:26:07 2022] POST /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:26:07.947711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad739d3e-1a06-4706-980f-58946f4444c4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 204 len: 0 microversion: 2.1 time: 0.116364 Aug 22 19:26:07.948445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 383/783] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:26:07 2022] DELETE /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 19:26:07.955837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:07.956677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:07.956880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:07.957548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:07.963984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.964202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.964446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.964663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.964888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.965574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.965702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.966287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:07.966558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.966748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:07.966894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:07.967308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:08.100208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:08.101359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:08.109384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-62efbe8e-2b4a-4668-babc-febade425773 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1724 microversion: 2.1 time: 0.158178 Aug 22 19:26:08.109641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0445201-8c79-408c-bec1-a3aae9cde148 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1578 microversion: 2.1 time: 0.156772 Aug 22 19:26:08.110165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 401/784] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:08.110472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 384/785] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:07 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:08.397474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7a448d6e-91c9-4f45-9a98-f20e0d6db7fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:08.399595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7a448d6e-91c9-4f45-9a98-f20e0d6db7fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:08.405901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a448d6e-91c9-4f45-9a98-f20e0d6db7fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:08.406372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a448d6e-91c9-4f45-9a98-f20e0d6db7fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:08.406799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a448d6e-91c9-4f45-9a98-f20e0d6db7fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:08.407476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a448d6e-91c9-4f45-9a98-f20e0d6db7fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:08.407952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a448d6e-91c9-4f45-9a98-f20e0d6db7fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:08.408372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a448d6e-91c9-4f45-9a98-f20e0d6db7fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:08.437198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7a448d6e-91c9-4f45-9a98-f20e0d6db7fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043855 Aug 22 19:26:08.437737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 402/786] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:08 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:08.537801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:08.538412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:08.545295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:08.545777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:08.546218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:08.546907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:08.547358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:08.547819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:08.565782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:08.689438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:08.697536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99c6cf03-dd34-430e-9440-e4bfe1184576 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.163566 Aug 22 19:26:08.698094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 385/787] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:08 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:09.130230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:09.131202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:09.134942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:09.135558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:09.137206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:09.137763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:09.138546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:09.138895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:09.139343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:09.139816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:09.145212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:09.145713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:09.146151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:09.146864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:09.147314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:09.147815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:09.294302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:09.302197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-63004950-140a-4c13-bc99-145739c2bdd0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1578 microversion: 2.1 time: 0.175839 Aug 22 19:26:09.302855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 403/788] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:09 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:09.391173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:09.399271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e4769ba-413b-4273-91be-b31e7dcae48b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1724 microversion: 2.1 time: 0.268079 Aug 22 19:26:09.399944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 386/789] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:09 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:09.449619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f418922c-cd3b-4dd6-8dbf-becacc9c656b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:09.451923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f418922c-cd3b-4dd6-8dbf-becacc9c656b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:09.458282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f418922c-cd3b-4dd6-8dbf-becacc9c656b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:09.458755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f418922c-cd3b-4dd6-8dbf-becacc9c656b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:09.459182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f418922c-cd3b-4dd6-8dbf-becacc9c656b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:09.459909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f418922c-cd3b-4dd6-8dbf-becacc9c656b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:09.460359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f418922c-cd3b-4dd6-8dbf-becacc9c656b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:09.460779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f418922c-cd3b-4dd6-8dbf-becacc9c656b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:09.490259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f418922c-cd3b-4dd6-8dbf-becacc9c656b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Aug 22 19:26:09.490819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 404/790] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:09 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:09.718350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:09.718959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:09.725734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:09.726207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:09.726638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:09.727317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:09.727788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:09.728207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:09.869584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:09.878052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08cbd397-7a35-4033-b195-dc4e98e2537a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.163515 Aug 22 19:26:09.878607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 387/791] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:09 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:10.322432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:10.323209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:10.329444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:10.330010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:10.330508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:10.331273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:10.331824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:10.332329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:10.421524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:10.422143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:10.424083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:10.429482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:10.429981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:10.430420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:10.431133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:10.431586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:10.432054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:10.475446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:10.484448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e8a6e81b-3a44-417e-aee0-bd04504059d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1578 microversion: 2.1 time: 0.165704 Aug 22 19:26:10.485038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 405/792] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:10 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:10.502725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f403ace8-170e-49b9-96d9-085aa27b9d6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:10.504778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f403ace8-170e-49b9-96d9-085aa27b9d6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:10.510851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f403ace8-170e-49b9-96d9-085aa27b9d6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:10.511332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f403ace8-170e-49b9-96d9-085aa27b9d6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:10.511807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f403ace8-170e-49b9-96d9-085aa27b9d6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:10.512511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f403ace8-170e-49b9-96d9-085aa27b9d6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:10.512967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f403ace8-170e-49b9-96d9-085aa27b9d6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:10.513389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f403ace8-170e-49b9-96d9-085aa27b9d6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:10.544706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f403ace8-170e-49b9-96d9-085aa27b9d6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045982 Aug 22 19:26:10.545289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 406/793] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:10 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:26:10.809063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:10.817350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0dbb1d0b-f159-4a6f-aaed-74c425de0c56 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1724 microversion: 2.1 time: 0.400207 Aug 22 19:26:10.817920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 388/794] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:10.900015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:10.900632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:10.903283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:10.908716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:10.909218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:10.909645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:10.910347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:10.910801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:10.911229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:11.059431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:11.067690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2e6fc815-d98d-42e9-bd85-af8b863a1df5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.171493 Aug 22 19:26:11.068266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 407/795] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:10 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:11.359199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-305626d3-c444-4ca0-be81-68c0e80e5a26 req-3de69160-60be-4a8b-a0f0-c0176d90056c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3f25ff-3b82-4e99-8f50-4b422b2f7b59", "name": "network-vif-deleted", "tag": "e7503875-9afe-45eb-baf3-3daa6a183bc6"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:26:11.368904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-305626d3-c444-4ca0-be81-68c0e80e5a26 req-3de69160-60be-4a8b-a0f0-c0176d90056c service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:11.369576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-305626d3-c444-4ca0-be81-68c0e80e5a26 req-3de69160-60be-4a8b-a0f0-c0176d90056c service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:11.370583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-305626d3-c444-4ca0-be81-68c0e80e5a26 req-3de69160-60be-4a8b-a0f0-c0176d90056c service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:11.382982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-305626d3-c444-4ca0-be81-68c0e80e5a26 req-3de69160-60be-4a8b-a0f0-c0176d90056c service nova] Creating event network-vif-deleted:e7503875-9afe-45eb-baf3-3daa6a183bc6 for instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 on hv-cinder-83538 Aug 22 19:26:11.389124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-305626d3-c444-4ca0-be81-68c0e80e5a26 req-3de69160-60be-4a8b-a0f0-c0176d90056c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033497 Aug 22 19:26:11.390069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 389/796] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:11.505925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:11.507279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:11.514152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:11.514835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:11.515496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:11.516341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:11.516902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:11.517420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:11.536341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:11.558292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-475b82d2-e494-432f-a245-51cc299f8472 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:11.560928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-475b82d2-e494-432f-a245-51cc299f8472 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:11.568465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-475b82d2-e494-432f-a245-51cc299f8472 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:11.569122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-475b82d2-e494-432f-a245-51cc299f8472 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:11.569888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-475b82d2-e494-432f-a245-51cc299f8472 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:11.570927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-475b82d2-e494-432f-a245-51cc299f8472 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:11.571536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-475b82d2-e494-432f-a245-51cc299f8472 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:11.572146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-475b82d2-e494-432f-a245-51cc299f8472 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:11.588312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:11.597533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-722773a0-fe95-4086-9091-a57fae6d36e6 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1510 microversion: 2.1 time: 0.095442 Aug 22 19:26:11.598719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 408/797] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:11 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:11.602697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-475b82d2-e494-432f-a245-51cc299f8472 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049321 Aug 22 19:26:11.603513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 390/798] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:11 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:26:11.840120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:11.840725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:11.847180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:11.847842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:11.848274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:11.848958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:11.849400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:11.849821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:11.975963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:11.984493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-57952159-d359-4fec-a072-4e985916b535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1724 microversion: 2.1 time: 0.148623 Aug 22 19:26:11.985084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 409/799] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:12.089449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:12.089991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:12.096591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:12.097339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:12.097774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:12.098477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:12.098931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:12.099353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:12.252285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:12.260750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2361ab02-2920-435e-a5c7-e94930ae1fda tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.175223 Aug 22 19:26:12.261317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 391/800] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:12 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:12.614479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8078e612-8ab9-4426-bb09-ca342879d0c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:12.616743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8078e612-8ab9-4426-bb09-ca342879d0c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:12.620117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:12.620728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:12.623392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8078e612-8ab9-4426-bb09-ca342879d0c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:12.623850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8078e612-8ab9-4426-bb09-ca342879d0c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:12.624283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8078e612-8ab9-4426-bb09-ca342879d0c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:12.624976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8078e612-8ab9-4426-bb09-ca342879d0c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:12.625429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8078e612-8ab9-4426-bb09-ca342879d0c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:12.625849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8078e612-8ab9-4426-bb09-ca342879d0c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:12.626511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:12.626985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:12.627412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:12.628120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:12.628563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:12.628983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:12.654866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8078e612-8ab9-4426-bb09-ca342879d0c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Aug 22 19:26:12.655428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 410/801] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:12 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:12.689575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:12.697279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9be5496-466d-42ca-a204-349cf04897f5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1510 microversion: 2.1 time: 0.080948 Aug 22 19:26:12.697942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 392/802] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:12 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1510 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:13.006229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:13.006841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:13.012736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:13.013219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:13.013652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:13.014339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:13.014792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:13.015213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:13.149324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:13.157410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6a2ba8f9-9768-4983-8bd2-09f07aed692f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1724 microversion: 2.1 time: 0.155182 Aug 22 19:26:13.157964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 411/803] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:13.281619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:13.282186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:13.288395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:13.288870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:13.289324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:13.290006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:13.290454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:13.290872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:13.434280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:13.442775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be1202b4-1b4c-4dd5-87e3-006e6eef99a1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.164996 Aug 22 19:26:13.443334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 393/804] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:13.666628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-659f109c-443c-4bd8-9f4c-f997464cf063 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:13.669326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-659f109c-443c-4bd8-9f4c-f997464cf063 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:13.675740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f109c-443c-4bd8-9f4c-f997464cf063 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:13.676221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f109c-443c-4bd8-9f4c-f997464cf063 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:13.676652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f109c-443c-4bd8-9f4c-f997464cf063 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:13.677340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f109c-443c-4bd8-9f4c-f997464cf063 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:13.677790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f109c-443c-4bd8-9f4c-f997464cf063 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:13.678225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f109c-443c-4bd8-9f4c-f997464cf063 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:13.706792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-659f109c-443c-4bd8-9f4c-f997464cf063 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Aug 22 19:26:13.707329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 412/805] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:13.815583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:13.816233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:13.822065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:13.822542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:13.822974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:13.824194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:13.824645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:13.825063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:13.894703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:13.902932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4456a4b-65ad-454f-862f-052d049726c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.187962 Aug 22 19:26:13.903492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 394/806] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:13 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:14.178858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:14.179468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:14.185905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.186376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.186804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.187482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.187953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.188369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.312488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:14.320487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-23df8789-9e05-4fbd-852a-be441293fe1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1730 microversion: 2.1 time: 0.145421 Aug 22 19:26:14.321046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 413/807] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:14.341266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f69b282-ec69-4a01-ab5d-923754c5dd2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:14.341791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f69b282-ec69-4a01-ab5d-923754c5dd2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:14.348405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f69b282-ec69-4a01-ab5d-923754c5dd2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.348883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f69b282-ec69-4a01-ab5d-923754c5dd2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.349314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f69b282-ec69-4a01-ab5d-923754c5dd2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.350009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f69b282-ec69-4a01-ab5d-923754c5dd2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.350459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f69b282-ec69-4a01-ab5d-923754c5dd2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.350882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f69b282-ec69-4a01-ab5d-923754c5dd2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.426705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f69b282-ec69-4a01-ab5d-923754c5dd2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089251 Aug 22 19:26:14.427300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 395/808] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Aug 22 19:26:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:14.463918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:14.464525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:14.470422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.470897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.471326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.472305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.472750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.473163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.615937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:14.625012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fa2b29f6-6aee-4079-9f57-437e59b2348a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.164966 Aug 22 19:26:14.625673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 414/809] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:14.720207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a23541c9-e14b-42d4-9460-82e7bb92f4f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:14.722929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a23541c9-e14b-42d4-9460-82e7bb92f4f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:14.729046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23541c9-e14b-42d4-9460-82e7bb92f4f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.730032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23541c9-e14b-42d4-9460-82e7bb92f4f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.730468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23541c9-e14b-42d4-9460-82e7bb92f4f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.731222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23541c9-e14b-42d4-9460-82e7bb92f4f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.731697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23541c9-e14b-42d4-9460-82e7bb92f4f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.732124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a23541c9-e14b-42d4-9460-82e7bb92f4f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.761629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a23541c9-e14b-42d4-9460-82e7bb92f4f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Aug 22 19:26:14.762197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 396/810] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:14.923053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:14.923670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:14.929876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.930352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.930775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.931459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:14.931955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:14.932375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:14.993721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:15.001440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-362814d1-6ea4-46f3-badc-bd6c6cc34068 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082187 Aug 22 19:26:15.002164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 415/811] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:14 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:15.282748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5867b753-1002-45ef-8df9-cf85d268b03b req-862a1ede-8657-468d-8a53-32aac651ff31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6744e43-5389-4422-9030-dfdf1b522dcc", "tag": "bec8e930-d13a-4c77-9943-50527898de38"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:26:15.292208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5867b753-1002-45ef-8df9-cf85d268b03b req-862a1ede-8657-468d-8a53-32aac651ff31 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:15.292682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5867b753-1002-45ef-8df9-cf85d268b03b req-862a1ede-8657-468d-8a53-32aac651ff31 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:15.293107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5867b753-1002-45ef-8df9-cf85d268b03b req-862a1ede-8657-468d-8a53-32aac651ff31 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:15.304402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5867b753-1002-45ef-8df9-cf85d268b03b req-862a1ede-8657-468d-8a53-32aac651ff31 service nova] Creating event network-changed:bec8e930-d13a-4c77-9943-50527898de38 for instance f6744e43-5389-4422-9030-dfdf1b522dcc on hv-cinder-83538 Aug 22 19:26:15.312362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5867b753-1002-45ef-8df9-cf85d268b03b req-862a1ede-8657-468d-8a53-32aac651ff31 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032985 Aug 22 19:26:15.312959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 397/812] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:15.645432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:15.646045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:15.651969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:15.652978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:15.653409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:15.654162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:15.655214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:15.655214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:15.774282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6051f13-935f-4be4-8c9a-62ee1ba55f8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:15.777875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6051f13-935f-4be4-8c9a-62ee1ba55f8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:15.784976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6051f13-935f-4be4-8c9a-62ee1ba55f8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:15.785789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6051f13-935f-4be4-8c9a-62ee1ba55f8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:15.786485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6051f13-935f-4be4-8c9a-62ee1ba55f8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:15.787435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6051f13-935f-4be4-8c9a-62ee1ba55f8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:15.788165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6051f13-935f-4be4-8c9a-62ee1ba55f8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:15.788949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6051f13-935f-4be4-8c9a-62ee1ba55f8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:15.802614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:15.811110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0cdafe5f-107a-4e0c-9394-923366c2a03c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1759 microversion: 2.1 time: 0.169315 Aug 22 19:26:15.822282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6051f13-935f-4be4-8c9a-62ee1ba55f8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052190 Aug 22 19:26:15.824972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 416/813] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:15 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:15.825854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 398/814] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:26:16.022679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:16.023434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:16.032102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:16.032546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:16.033133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:16.033838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:16.035468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:16.035468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:16.102808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:16.110781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7f673deb-c4bd-435b-8540-967b356c638a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.093445 Aug 22 19:26:16.111551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 417/815] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:16 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:16.832365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:16.832996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:16.833571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a7daf4e2-2c37-49bc-8ca3-3661e7c8735a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:16.835842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a7daf4e2-2c37-49bc-8ca3-3661e7c8735a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:16.839384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:16.841286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:16.841736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:16.842345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7daf4e2-2c37-49bc-8ca3-3661e7c8735a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:16.842469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:16.842827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7daf4e2-2c37-49bc-8ca3-3661e7c8735a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:16.842990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:16.843281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7daf4e2-2c37-49bc-8ca3-3661e7c8735a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:16.843442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:16.844012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7daf4e2-2c37-49bc-8ca3-3661e7c8735a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:16.844468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7daf4e2-2c37-49bc-8ca3-3661e7c8735a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:16.844890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7daf4e2-2c37-49bc-8ca3-3661e7c8735a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:16.873942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a7daf4e2-2c37-49bc-8ca3-3661e7c8735a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Aug 22 19:26:16.874506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 418/816] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:26:16.986140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:16.994187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2275c5e-b1ee-4469-b4ea-e62074301c55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1762 microversion: 2.1 time: 0.165754 Aug 22 19:26:16.994753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 399/817] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:16 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1762 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:17.131325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:17.131889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:17.138921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:17.139403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:17.139870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:17.140566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:17.141018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:17.141440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:17.200783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:17.208279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f260e65e-a9a3-4ab4-bff7-ed8ee4bf40a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080848 Aug 22 19:26:17.208867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 419/818] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:17 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:17.326932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-80950003-90ef-4f90-8d24-5ea9cf10763b req-85f863da-6b76-4215-b4d0-815e46a86060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6744e43-5389-4422-9030-dfdf1b522dcc", "tag": "bec8e930-d13a-4c77-9943-50527898de38"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:26:17.336165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80950003-90ef-4f90-8d24-5ea9cf10763b req-85f863da-6b76-4215-b4d0-815e46a86060 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:17.336633 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80950003-90ef-4f90-8d24-5ea9cf10763b req-85f863da-6b76-4215-b4d0-815e46a86060 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:17.337058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-80950003-90ef-4f90-8d24-5ea9cf10763b req-85f863da-6b76-4215-b4d0-815e46a86060 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:17.347942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-80950003-90ef-4f90-8d24-5ea9cf10763b req-85f863da-6b76-4215-b4d0-815e46a86060 service nova] Creating event network-changed:bec8e930-d13a-4c77-9943-50527898de38 for instance f6744e43-5389-4422-9030-dfdf1b522dcc on hv-cinder-83538 Aug 22 19:26:17.352608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-80950003-90ef-4f90-8d24-5ea9cf10763b req-85f863da-6b76-4215-b4d0-815e46a86060 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029914 Aug 22 19:26:17.353151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 400/819] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:17.885885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fe45d36a-9ad0-4247-bfe8-20131a198a2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:17.888728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fe45d36a-9ad0-4247-bfe8-20131a198a2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:17.894911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe45d36a-9ad0-4247-bfe8-20131a198a2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:17.895395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe45d36a-9ad0-4247-bfe8-20131a198a2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:17.895891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe45d36a-9ad0-4247-bfe8-20131a198a2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:17.896585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe45d36a-9ad0-4247-bfe8-20131a198a2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:17.897036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe45d36a-9ad0-4247-bfe8-20131a198a2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:17.897458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe45d36a-9ad0-4247-bfe8-20131a198a2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:17.926092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fe45d36a-9ad0-4247-bfe8-20131a198a2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Aug 22 19:26:17.926639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 420/820] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:18.229931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:18.230628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:18.236803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:18.237287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:18.237725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:18.238413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:18.238865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:18.239290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:18.300547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:18.308133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2731481-ce52-4ed1-b11d-25f488a12586 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083017 Aug 22 19:26:18.309408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 401/821] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:18 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:18.938200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c342d49b-e3f5-41a1-9dec-56289b674f78 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:18.940377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c342d49b-e3f5-41a1-9dec-56289b674f78 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:18.946742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c342d49b-e3f5-41a1-9dec-56289b674f78 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:18.947219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c342d49b-e3f5-41a1-9dec-56289b674f78 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:18.947676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c342d49b-e3f5-41a1-9dec-56289b674f78 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:18.948355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c342d49b-e3f5-41a1-9dec-56289b674f78 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:18.948806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c342d49b-e3f5-41a1-9dec-56289b674f78 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:18.949739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c342d49b-e3f5-41a1-9dec-56289b674f78 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:18.978159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c342d49b-e3f5-41a1-9dec-56289b674f78 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Aug 22 19:26:18.978701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 421/822] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:19.329007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:19.329646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:19.335981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:19.336463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:19.336897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:19.337584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:19.338062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:19.338488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:19.401363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:19.409460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60da2705-451a-478e-ac45-f8bf8fb88f88 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084343 Aug 22 19:26:19.410031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 402/823] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:19 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:19.990438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a137c365-03f3-4466-bb72-dd9068e6f983 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:19.992602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a137c365-03f3-4466-bb72-dd9068e6f983 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:19.998946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a137c365-03f3-4466-bb72-dd9068e6f983 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:19.999426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a137c365-03f3-4466-bb72-dd9068e6f983 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:19.999895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a137c365-03f3-4466-bb72-dd9068e6f983 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:20.000585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a137c365-03f3-4466-bb72-dd9068e6f983 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:20.001032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a137c365-03f3-4466-bb72-dd9068e6f983 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:20.001456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a137c365-03f3-4466-bb72-dd9068e6f983 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:20.030313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a137c365-03f3-4466-bb72-dd9068e6f983 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Aug 22 19:26:20.030856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 422/824] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:19 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:20.430112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:20.430748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:20.437672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:20.438149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:20.438575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:20.439283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:20.439945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:20.440365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:20.499910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:20.507614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95cc49fc-bb6f-484a-9b80-004282e2b459 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081141 Aug 22 19:26:20.508189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 403/825] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:20 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:21.042589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-57c30345-83a2-476d-b0df-3cda419d703a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:21.045272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-57c30345-83a2-476d-b0df-3cda419d703a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:21.051633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57c30345-83a2-476d-b0df-3cda419d703a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:21.052135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57c30345-83a2-476d-b0df-3cda419d703a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:21.052565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57c30345-83a2-476d-b0df-3cda419d703a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:21.053252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57c30345-83a2-476d-b0df-3cda419d703a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:21.053706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57c30345-83a2-476d-b0df-3cda419d703a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:21.054136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57c30345-83a2-476d-b0df-3cda419d703a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:21.083404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-57c30345-83a2-476d-b0df-3cda419d703a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044817 Aug 22 19:26:21.083980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 423/826] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:21.528368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:21.528979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:21.536427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:21.536904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:21.537332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:21.538016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:21.538464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:21.538882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:21.556853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:21.600922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:21.608699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-14d2f0c3-b721-41a0-bf40-ef63cdfd47e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084089 Aug 22 19:26:21.609344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 404/827] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:21 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:22.094629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9cd835e6-8f90-49b7-848c-2d2db1a92c8e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:22.096772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9cd835e6-8f90-49b7-848c-2d2db1a92c8e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:22.103275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cd835e6-8f90-49b7-848c-2d2db1a92c8e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:22.103899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cd835e6-8f90-49b7-848c-2d2db1a92c8e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:22.104330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cd835e6-8f90-49b7-848c-2d2db1a92c8e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:22.105009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cd835e6-8f90-49b7-848c-2d2db1a92c8e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:22.105453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cd835e6-8f90-49b7-848c-2d2db1a92c8e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:22.106379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cd835e6-8f90-49b7-848c-2d2db1a92c8e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:22.135265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9cd835e6-8f90-49b7-848c-2d2db1a92c8e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044522 Aug 22 19:26:22.135911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 424/828] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:22.628767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:22.629368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:22.635853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:22.636329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:22.636756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:22.637980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:22.638422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:22.638837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:22.698182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:22.706407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-634456e8-347c-4fdd-b99e-69aaa6a3cc87 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081470 Aug 22 19:26:22.707074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 405/829] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:22 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:23.147628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d314a78e-2edb-45a4-be6b-fd32ee010dae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:23.149806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d314a78e-2edb-45a4-be6b-fd32ee010dae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:23.156320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d314a78e-2edb-45a4-be6b-fd32ee010dae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:23.156793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d314a78e-2edb-45a4-be6b-fd32ee010dae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:23.157219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d314a78e-2edb-45a4-be6b-fd32ee010dae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:23.157898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d314a78e-2edb-45a4-be6b-fd32ee010dae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:23.158340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d314a78e-2edb-45a4-be6b-fd32ee010dae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:23.158757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d314a78e-2edb-45a4-be6b-fd32ee010dae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:23.162413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:23.187866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d314a78e-2edb-45a4-be6b-fd32ee010dae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044100 Aug 22 19:26:23.188408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 425/830] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:23.726377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:23.726985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:23.733972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:23.734444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:23.734871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:23.735553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:23.736047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:23.736467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:23.800477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:23.808255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f52c6f29-fb01-49e7-9ea2-89a386d032a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.085599 Aug 22 19:26:23.808819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 406/831] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:23 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:24.199329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0601fef2-ba23-49c9-90d9-9adb38bf185c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:24.202001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0601fef2-ba23-49c9-90d9-9adb38bf185c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:24.208303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0601fef2-ba23-49c9-90d9-9adb38bf185c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:24.208795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0601fef2-ba23-49c9-90d9-9adb38bf185c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:24.209219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0601fef2-ba23-49c9-90d9-9adb38bf185c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:24.209892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0601fef2-ba23-49c9-90d9-9adb38bf185c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:24.210335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0601fef2-ba23-49c9-90d9-9adb38bf185c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:24.210750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0601fef2-ba23-49c9-90d9-9adb38bf185c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:24.239766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0601fef2-ba23-49c9-90d9-9adb38bf185c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Aug 22 19:26:24.240309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 426/832] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:24.828991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:24.829702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:24.836020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:24.836496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:24.836923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:24.837603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:24.838045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:24.838461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:24.898394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:24.906550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9cdd0d2-b59f-4fe2-a1b0-2f48a161161e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081235 Aug 22 19:26:24.907106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 407/833] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:24 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:25.252804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5d270f72-3524-46f4-bb3b-acd936f92fcf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:25.254944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5d270f72-3524-46f4-bb3b-acd936f92fcf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:25.261387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d270f72-3524-46f4-bb3b-acd936f92fcf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:25.261862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d270f72-3524-46f4-bb3b-acd936f92fcf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:25.262295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d270f72-3524-46f4-bb3b-acd936f92fcf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:25.262981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d270f72-3524-46f4-bb3b-acd936f92fcf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:25.263450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d270f72-3524-46f4-bb3b-acd936f92fcf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:25.263879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d270f72-3524-46f4-bb3b-acd936f92fcf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:25.292499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5d270f72-3524-46f4-bb3b-acd936f92fcf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Aug 22 19:26:25.293053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 427/834] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:25 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:25.927370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:25.928006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:25.934269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:25.934746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:25.935175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:25.935892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:25.936337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:25.936752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:25.997170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:26.004787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92645ba9-d512-4909-85b3-329720b0479d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081331 Aug 22 19:26:26.005342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 408/835] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:25 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:26.304763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8d1e435f-fe8b-4298-9ba6-d8e07d94694b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:26.306803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8d1e435f-fe8b-4298-9ba6-d8e07d94694b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:26.313155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1e435f-fe8b-4298-9ba6-d8e07d94694b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:26.313639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1e435f-fe8b-4298-9ba6-d8e07d94694b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:26.314121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1e435f-fe8b-4298-9ba6-d8e07d94694b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:26.314823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1e435f-fe8b-4298-9ba6-d8e07d94694b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:26.315330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1e435f-fe8b-4298-9ba6-d8e07d94694b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:26.315785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d1e435f-fe8b-4298-9ba6-d8e07d94694b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:26.346031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8d1e435f-fe8b-4298-9ba6-d8e07d94694b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045297 Aug 22 19:26:26.346603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 428/836] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:26 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:27.025951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:27.026543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:27.032945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:27.033427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:27.033852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:27.034538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:27.034988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:27.035405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:27.112492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:27.120228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48c22a46-c4e1-4f87-9292-c048000fa46e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.098152 Aug 22 19:26:27.120790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 409/837] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:27 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:27.358623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6077d11f-9ca8-412b-9abc-9c4f65b57724 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:27.361230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6077d11f-9ca8-412b-9abc-9c4f65b57724 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:27.367722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6077d11f-9ca8-412b-9abc-9c4f65b57724 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:27.368206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6077d11f-9ca8-412b-9abc-9c4f65b57724 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:27.368700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6077d11f-9ca8-412b-9abc-9c4f65b57724 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:27.369392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6077d11f-9ca8-412b-9abc-9c4f65b57724 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:27.369843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6077d11f-9ca8-412b-9abc-9c4f65b57724 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:27.370266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6077d11f-9ca8-412b-9abc-9c4f65b57724 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:27.398950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6077d11f-9ca8-412b-9abc-9c4f65b57724 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044501 Aug 22 19:26:27.399486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 429/838] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:28.142392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:28.142999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:28.148945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:28.149420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:28.149848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:28.150530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:28.150974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:28.151387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:28.212643 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:28.220412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6119947e-613b-451a-9d1e-5837a48ec4b9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082487 Aug 22 19:26:28.220968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 410/839] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:28 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:28.410814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bfcc757a-0e22-4d02-b955-7fb2ec51963e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:28.412902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bfcc757a-0e22-4d02-b955-7fb2ec51963e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:28.419239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfcc757a-0e22-4d02-b955-7fb2ec51963e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:28.419745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfcc757a-0e22-4d02-b955-7fb2ec51963e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:28.420177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfcc757a-0e22-4d02-b955-7fb2ec51963e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:28.420892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfcc757a-0e22-4d02-b955-7fb2ec51963e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:28.421342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfcc757a-0e22-4d02-b955-7fb2ec51963e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:28.421769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfcc757a-0e22-4d02-b955-7fb2ec51963e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:28.450204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bfcc757a-0e22-4d02-b955-7fb2ec51963e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Aug 22 19:26:28.450751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 430/840] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:29.241088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:29.242292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:29.255386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:29.255899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:29.256335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:29.257030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:29.257480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:29.257904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:29.319436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:29.326991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c93bfbd-8aa6-4f49-8cb8-bf06c6bcda50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.090014 Aug 22 19:26:29.327547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 411/841] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:29 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:29.462378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1b825678-b707-4a12-b439-904aa2daaf16 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:29.464622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1b825678-b707-4a12-b439-904aa2daaf16 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:29.471551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b825678-b707-4a12-b439-904aa2daaf16 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:29.472320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b825678-b707-4a12-b439-904aa2daaf16 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:29.472759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b825678-b707-4a12-b439-904aa2daaf16 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:29.473451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b825678-b707-4a12-b439-904aa2daaf16 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:29.473943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b825678-b707-4a12-b439-904aa2daaf16 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:29.474465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b825678-b707-4a12-b439-904aa2daaf16 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:29.505058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1b825678-b707-4a12-b439-904aa2daaf16 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046591 Aug 22 19:26:29.505612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 431/842] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:30.347842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:30.348449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:30.355129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:30.355615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:30.356080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:30.356772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:30.357225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:30.357650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:30.418110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:30.426328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c4c95e9-e5e5-48b5-a84e-6e1ef9fd8c48 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082601 Aug 22 19:26:30.426919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 412/843] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:30 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:30.516373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f2f56926-23a5-4abe-aa63-66466586bb0d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:30.518511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f2f56926-23a5-4abe-aa63-66466586bb0d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:30.524838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2f56926-23a5-4abe-aa63-66466586bb0d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:30.525312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2f56926-23a5-4abe-aa63-66466586bb0d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:30.525741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2f56926-23a5-4abe-aa63-66466586bb0d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:30.526426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2f56926-23a5-4abe-aa63-66466586bb0d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:30.526873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2f56926-23a5-4abe-aa63-66466586bb0d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:30.527292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f2f56926-23a5-4abe-aa63-66466586bb0d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:30.556058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f2f56926-23a5-4abe-aa63-66466586bb0d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043578 Aug 22 19:26:30.556602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 432/844] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:30 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:31.447255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:31.447906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:31.455369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:31.455883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:31.456324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:31.457023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:31.457480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:31.457914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:31.524063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:31.531789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ef547c7-4aa5-47b4-9ba2-36e95876bd29 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.088343 Aug 22 19:26:31.532347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 413/845] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:31 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:31.568672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2ae320cc-af4d-4a95-af71-267a247c76a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:31.570784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2ae320cc-af4d-4a95-af71-267a247c76a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:31.576763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ae320cc-af4d-4a95-af71-267a247c76a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:31.577241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ae320cc-af4d-4a95-af71-267a247c76a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:31.578322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ae320cc-af4d-4a95-af71-267a247c76a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:31.579027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ae320cc-af4d-4a95-af71-267a247c76a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:31.579477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ae320cc-af4d-4a95-af71-267a247c76a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:31.579946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ae320cc-af4d-4a95-af71-267a247c76a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:31.608155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2ae320cc-af4d-4a95-af71-267a247c76a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 Aug 22 19:26:31.609415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 433/846] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:32.551285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:32.551971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:32.558443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:32.558927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:32.559365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:32.560089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:32.560549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:32.560977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:32.620889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4f585c63-02d2-46e6-b77c-2b4f3f9e237e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:32.621999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:32.623032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4f585c63-02d2-46e6-b77c-2b4f3f9e237e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:32.629832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f585c63-02d2-46e6-b77c-2b4f3f9e237e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:32.630431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f585c63-02d2-46e6-b77c-2b4f3f9e237e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:32.630574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8cc36b63-2e68-4ea2-b40f-22a561a8b5d2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083017 Aug 22 19:26:32.630864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f585c63-02d2-46e6-b77c-2b4f3f9e237e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:32.630986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 414/847] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:32 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:32.631629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f585c63-02d2-46e6-b77c-2b4f3f9e237e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:32.632176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f585c63-02d2-46e6-b77c-2b4f3f9e237e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:32.632603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f585c63-02d2-46e6-b77c-2b4f3f9e237e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:32.660496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4f585c63-02d2-46e6-b77c-2b4f3f9e237e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 Aug 22 19:26:32.661037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 434/848] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:26:33.650602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:33.651241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:33.658084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:33.658565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:33.659002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:33.659715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:33.660170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:33.660923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:33.673091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-aa9e6ad4-aabb-4e32-ab1f-e6ce586fef35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:33.675206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-aa9e6ad4-aabb-4e32-ab1f-e6ce586fef35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:33.681507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa9e6ad4-aabb-4e32-ab1f-e6ce586fef35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:33.682070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa9e6ad4-aabb-4e32-ab1f-e6ce586fef35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:33.682501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa9e6ad4-aabb-4e32-ab1f-e6ce586fef35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:33.683189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa9e6ad4-aabb-4e32-ab1f-e6ce586fef35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:33.683633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa9e6ad4-aabb-4e32-ab1f-e6ce586fef35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:33.684078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa9e6ad4-aabb-4e32-ab1f-e6ce586fef35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:33.713775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-aa9e6ad4-aabb-4e32-ab1f-e6ce586fef35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Aug 22 19:26:33.714348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 435/849] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:33 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:26:33.722471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:33.730163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b131573e-6b8b-45c2-a3da-5e27b2fb765f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083426 Aug 22 19:26:33.730723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 415/850] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:33 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:34.726764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4384313c-4d94-4869-99db-c12197548b10 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:34.728971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4384313c-4d94-4869-99db-c12197548b10 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:34.741202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4384313c-4d94-4869-99db-c12197548b10 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:34.741679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4384313c-4d94-4869-99db-c12197548b10 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:34.742112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4384313c-4d94-4869-99db-c12197548b10 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:34.742884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4384313c-4d94-4869-99db-c12197548b10 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:34.743397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4384313c-4d94-4869-99db-c12197548b10 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:34.743869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4384313c-4d94-4869-99db-c12197548b10 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:34.750969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:34.751578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:34.758283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:34.758782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:34.759199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:34.759930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:34.760389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:34.760805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:34.826602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:34.834955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a92c63a-4f3d-4c90-bea3-d86924d8db05 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.088334 Aug 22 19:26:34.835540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 416/851] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:34 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:34.929561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4384313c-4d94-4869-99db-c12197548b10 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206705 Aug 22 19:26:34.930143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 436/852] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:35.855727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:35.856349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:35.862744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:35.863230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:35.863700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:35.864418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:35.864870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:35.865295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:35.928263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:35.935912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cdece989-46cb-460a-af62-ec81ac209a54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084032 Aug 22 19:26:35.936488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 417/853] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:35 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:35.942449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e3b0ad2d-6416-4c82-9745-c146ab31da2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:35.944629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e3b0ad2d-6416-4c82-9745-c146ab31da2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:35.951586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b0ad2d-6416-4c82-9745-c146ab31da2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:35.952090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b0ad2d-6416-4c82-9745-c146ab31da2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:35.953144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b0ad2d-6416-4c82-9745-c146ab31da2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:35.953820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b0ad2d-6416-4c82-9745-c146ab31da2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:35.954270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b0ad2d-6416-4c82-9745-c146ab31da2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:35.954694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b0ad2d-6416-4c82-9745-c146ab31da2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:35.982822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e3b0ad2d-6416-4c82-9745-c146ab31da2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Aug 22 19:26:35.983355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 437/854] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:36.956851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:36.957512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:36.963840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:36.964318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:36.964748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:36.965435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:36.965882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:36.966303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:36.994513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-277fbc5d-87d3-4326-94d4-82005fab4f8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:36.996657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-277fbc5d-87d3-4326-94d4-82005fab4f8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:37.003022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-277fbc5d-87d3-4326-94d4-82005fab4f8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:37.003496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-277fbc5d-87d3-4326-94d4-82005fab4f8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:37.003955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-277fbc5d-87d3-4326-94d4-82005fab4f8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:37.004648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-277fbc5d-87d3-4326-94d4-82005fab4f8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:37.005120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-277fbc5d-87d3-4326-94d4-82005fab4f8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:37.005541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-277fbc5d-87d3-4326-94d4-82005fab4f8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:37.027193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:37.035614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d15845cb-ee9a-4c85-aab7-8ec58d94fed4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083062 Aug 22 19:26:37.035893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-277fbc5d-87d3-4326-94d4-82005fab4f8a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045145 Aug 22 19:26:37.036187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 418/855] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:36 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:37.036433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 438/856] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:26:38.048698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1ba1ba9-19fc-4c49-9094-a5a8454a975f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:38.050916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1ba1ba9-19fc-4c49-9094-a5a8454a975f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:38.055845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:38.056491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:38.057230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1ba1ba9-19fc-4c49-9094-a5a8454a975f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:38.057722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1ba1ba9-19fc-4c49-9094-a5a8454a975f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:38.058155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1ba1ba9-19fc-4c49-9094-a5a8454a975f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:38.058854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1ba1ba9-19fc-4c49-9094-a5a8454a975f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:38.059308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1ba1ba9-19fc-4c49-9094-a5a8454a975f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:38.059754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1ba1ba9-19fc-4c49-9094-a5a8454a975f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:38.062770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:38.063256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:38.063720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:38.064419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:38.064876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:38.065312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:38.088466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1ba1ba9-19fc-4c49-9094-a5a8454a975f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Aug 22 19:26:38.089023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 419/857] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:38.126882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:38.134624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b01e8700-eacf-46ed-a6d7-eb5f3debc636 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082674 Aug 22 19:26:38.135177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 439/858] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:38 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:39.101220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35c0e56d-3a8e-400f-8c3f-93feaa5d37a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:39.103373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35c0e56d-3a8e-400f-8c3f-93feaa5d37a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:39.110080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35c0e56d-3a8e-400f-8c3f-93feaa5d37a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:39.110562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35c0e56d-3a8e-400f-8c3f-93feaa5d37a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:39.110994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35c0e56d-3a8e-400f-8c3f-93feaa5d37a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:39.111707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35c0e56d-3a8e-400f-8c3f-93feaa5d37a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:39.112156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35c0e56d-3a8e-400f-8c3f-93feaa5d37a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:39.112574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35c0e56d-3a8e-400f-8c3f-93feaa5d37a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:39.143667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35c0e56d-3a8e-400f-8c3f-93feaa5d37a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046582 Aug 22 19:26:39.144237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 420/859] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:39.154408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:39.155058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:39.162905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:39.163392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:39.163865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:39.164571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:39.165025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:39.165451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:39.225758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:39.233424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-69ef2762-13a8-4071-b401-e1dc6a397f76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083053 Aug 22 19:26:39.233967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 440/860] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:39 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:40.155937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e579a2b6-520c-453a-99a2-31635c0664d4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:40.158081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e579a2b6-520c-453a-99a2-31635c0664d4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:40.164438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e579a2b6-520c-453a-99a2-31635c0664d4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:40.164916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e579a2b6-520c-453a-99a2-31635c0664d4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:40.165351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e579a2b6-520c-453a-99a2-31635c0664d4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:40.166037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e579a2b6-520c-453a-99a2-31635c0664d4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:40.166486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e579a2b6-520c-453a-99a2-31635c0664d4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:40.166910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e579a2b6-520c-453a-99a2-31635c0664d4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:40.170522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:40.196280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e579a2b6-520c-453a-99a2-31635c0664d4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 Aug 22 19:26:40.196824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 421/861] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:40.254022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:40.254634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:40.260996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:40.261477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:40.261912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:40.262596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:40.263055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:40.263473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:40.325610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:40.328995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:40.334191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bbba60ec-0ab8-4e5e-8162-bac3bdaf4809 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084074 Aug 22 19:26:40.334748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 441/862] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:40 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:41.209140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-346c165a-a812-4f07-a15e-7e34d980e75f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:41.211281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-346c165a-a812-4f07-a15e-7e34d980e75f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:41.213686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=68 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:41.218837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-346c165a-a812-4f07-a15e-7e34d980e75f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:41.219315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-346c165a-a812-4f07-a15e-7e34d980e75f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:41.219781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-346c165a-a812-4f07-a15e-7e34d980e75f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:41.220477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-346c165a-a812-4f07-a15e-7e34d980e75f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:41.220935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-346c165a-a812-4f07-a15e-7e34d980e75f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:41.221383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-346c165a-a812-4f07-a15e-7e34d980e75f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:41.250784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-346c165a-a812-4f07-a15e-7e34d980e75f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Aug 22 19:26:41.251334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 422/863] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:41 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:41.355331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:41.355972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:41.358438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=70 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:41.364107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:41.364587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:41.365015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:41.365696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:41.366143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:41.366560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:41.428343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:41.435845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-89b51a5b-07f7-44bd-86fc-2865106b0ddc tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084257 Aug 22 19:26:41.436391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 442/864] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:41 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:42.263075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f701b0e-fe49-412c-941d-775db0fc19da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:42.265222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f701b0e-fe49-412c-941d-775db0fc19da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:42.271553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f701b0e-fe49-412c-941d-775db0fc19da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:42.272076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f701b0e-fe49-412c-941d-775db0fc19da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:42.272506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f701b0e-fe49-412c-941d-775db0fc19da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:42.273198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f701b0e-fe49-412c-941d-775db0fc19da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:42.273648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f701b0e-fe49-412c-941d-775db0fc19da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:42.274061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f701b0e-fe49-412c-941d-775db0fc19da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:42.303747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f701b0e-fe49-412c-941d-775db0fc19da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Aug 22 19:26:42.304305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 423/865] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:42.456697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:42.457308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:42.463725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:42.464207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:42.464637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:42.465316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:42.465759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:42.466180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:42.525997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:42.534067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e7a50618-74e0-4c3c-ac1d-3fdd0ad821ac tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081255 Aug 22 19:26:42.534635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 443/866] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:42 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:43.316200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2958a3e-e2b9-45a4-9770-be231f3b3936 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:43.318315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2958a3e-e2b9-45a4-9770-be231f3b3936 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:43.324725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2958a3e-e2b9-45a4-9770-be231f3b3936 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:43.325197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2958a3e-e2b9-45a4-9770-be231f3b3936 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:43.325625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2958a3e-e2b9-45a4-9770-be231f3b3936 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:43.326302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2958a3e-e2b9-45a4-9770-be231f3b3936 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:43.326749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2958a3e-e2b9-45a4-9770-be231f3b3936 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:43.327169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2958a3e-e2b9-45a4-9770-be231f3b3936 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:43.355586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2958a3e-e2b9-45a4-9770-be231f3b3936 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Aug 22 19:26:43.356150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 424/867] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:43 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:43.554677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:43.555416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:43.562596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:43.563071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:43.563500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:43.564208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:43.564654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:43.565072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:43.625902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:43.633435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a23aa718-2b66-4dea-b826-d68472e3802b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082587 Aug 22 19:26:43.633988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 444/868] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:43 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:44.367782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b77c15b7-1f9e-40fd-b0c3-7d15e6d8bc20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:44.369912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b77c15b7-1f9e-40fd-b0c3-7d15e6d8bc20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:44.376502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77c15b7-1f9e-40fd-b0c3-7d15e6d8bc20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:44.376985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77c15b7-1f9e-40fd-b0c3-7d15e6d8bc20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:44.377425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77c15b7-1f9e-40fd-b0c3-7d15e6d8bc20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:44.378113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77c15b7-1f9e-40fd-b0c3-7d15e6d8bc20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:44.378567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77c15b7-1f9e-40fd-b0c3-7d15e6d8bc20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:44.378990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b77c15b7-1f9e-40fd-b0c3-7d15e6d8bc20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:44.408411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b77c15b7-1f9e-40fd-b0c3-7d15e6d8bc20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044561 Aug 22 19:26:44.408890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 425/869] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:44 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:44.652881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:44.653492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:44.660665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:44.661131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:44.661569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:44.662257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:44.662713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:44.663138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:44.725586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:44.733406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bded1c8e-33a3-49e8-acf2-846727bd2fb4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084312 Aug 22 19:26:44.733961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 445/870] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:44 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:45.420883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-347736cb-0bf6-4830-a0ba-435809034066 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:45.423449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-347736cb-0bf6-4830-a0ba-435809034066 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:45.429761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-347736cb-0bf6-4830-a0ba-435809034066 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:45.430236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-347736cb-0bf6-4830-a0ba-435809034066 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:45.430667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-347736cb-0bf6-4830-a0ba-435809034066 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:45.431348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-347736cb-0bf6-4830-a0ba-435809034066 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:45.431837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-347736cb-0bf6-4830-a0ba-435809034066 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:45.432252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-347736cb-0bf6-4830-a0ba-435809034066 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:45.461215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-347736cb-0bf6-4830-a0ba-435809034066 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044316 Aug 22 19:26:45.461763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 426/871] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:45 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:45.753651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:45.754268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:45.760701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:45.761187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:45.761627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:45.762350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:45.762808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:45.763238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:45.822515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:45.830630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-df13282a-8e28-417d-a858-1e6ce9b8e863 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080833 Aug 22 19:26:45.831190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 446/872] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:45 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:46.473928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-68b6dc9d-b292-4b69-a254-3e1bc251d8f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:46.476140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-68b6dc9d-b292-4b69-a254-3e1bc251d8f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:46.482483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b6dc9d-b292-4b69-a254-3e1bc251d8f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:46.482961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b6dc9d-b292-4b69-a254-3e1bc251d8f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:46.483396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b6dc9d-b292-4b69-a254-3e1bc251d8f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:46.484143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b6dc9d-b292-4b69-a254-3e1bc251d8f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:46.484596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b6dc9d-b292-4b69-a254-3e1bc251d8f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:46.485021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68b6dc9d-b292-4b69-a254-3e1bc251d8f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:46.513461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-68b6dc9d-b292-4b69-a254-3e1bc251d8f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Aug 22 19:26:46.514002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 427/873] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:46 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:46.851396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:46.851971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:46.858357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:46.858829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:46.859258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:46.859978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:46.860425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:46.860842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:46.919780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:46.927354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a0dcf9d2-4df8-4362-b9aa-c0aa90137ed5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.079818 Aug 22 19:26:46.927950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 447/874] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:46 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:26:47.205551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:26:47.205731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:26:47.526446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23f53e2b-8578-445d-8cbd-0840b4cf250c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:47.528611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-23f53e2b-8578-445d-8cbd-0840b4cf250c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:47.535663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23f53e2b-8578-445d-8cbd-0840b4cf250c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:47.536151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23f53e2b-8578-445d-8cbd-0840b4cf250c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:47.536585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23f53e2b-8578-445d-8cbd-0840b4cf250c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:47.537274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23f53e2b-8578-445d-8cbd-0840b4cf250c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:47.537726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23f53e2b-8578-445d-8cbd-0840b4cf250c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:47.538149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23f53e2b-8578-445d-8cbd-0840b4cf250c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:47.566062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-23f53e2b-8578-445d-8cbd-0840b4cf250c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043578 Aug 22 19:26:47.566595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 428/875] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:47 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:47.948679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:47.949328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:47.956192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:47.956677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:47.957118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:47.957812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:47.958268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:47.958697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:48.020324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:48.027843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0202d2e1-9c1f-4336-8196-e9efdb05010a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083070 Aug 22 19:26:48.028405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 448/876] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:47 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:48.578672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9794d4e-9419-4bb4-b513-0373edc4da83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:48.580863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d9794d4e-9419-4bb4-b513-0373edc4da83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:48.587107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9794d4e-9419-4bb4-b513-0373edc4da83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:48.587573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9794d4e-9419-4bb4-b513-0373edc4da83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:48.588028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9794d4e-9419-4bb4-b513-0373edc4da83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:48.588702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9794d4e-9419-4bb4-b513-0373edc4da83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:48.589145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9794d4e-9419-4bb4-b513-0373edc4da83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:48.589560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9794d4e-9419-4bb4-b513-0373edc4da83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:48.618407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9794d4e-9419-4bb4-b513-0373edc4da83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Aug 22 19:26:48.618948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 429/877] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:48 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:49.048125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:49.048698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:49.054977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:49.055456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:49.055917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:49.056602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:49.057052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:49.057469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:49.120128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:49.128442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6bc784c5-2495-4d5d-a7d6-89963c564043 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084709 Aug 22 19:26:49.128993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 449/878] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:49 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:49.631016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc475fdc-d914-4c5e-977b-a7b673c0bdaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:49.633287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc475fdc-d914-4c5e-977b-a7b673c0bdaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:49.639722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc475fdc-d914-4c5e-977b-a7b673c0bdaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:49.640206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc475fdc-d914-4c5e-977b-a7b673c0bdaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:49.640641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc475fdc-d914-4c5e-977b-a7b673c0bdaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:49.641329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc475fdc-d914-4c5e-977b-a7b673c0bdaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:49.641779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc475fdc-d914-4c5e-977b-a7b673c0bdaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:49.642203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc475fdc-d914-4c5e-977b-a7b673c0bdaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:49.671718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc475fdc-d914-4c5e-977b-a7b673c0bdaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Aug 22 19:26:49.672251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 430/879] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:49 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:50.148830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:50.149462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:50.156408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:50.156885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:50.157312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:50.157991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:50.158438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:50.158858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:50.217780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:50.226170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-63673f09-ea62-47c3-9904-f748e67264c2 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081153 Aug 22 19:26:50.226721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 450/880] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:50 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:50.683850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6b19c5a-8990-415c-8be5-173bbe60d2c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:50.686015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6b19c5a-8990-415c-8be5-173bbe60d2c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:50.693009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b19c5a-8990-415c-8be5-173bbe60d2c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:50.693489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b19c5a-8990-415c-8be5-173bbe60d2c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:50.693925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b19c5a-8990-415c-8be5-173bbe60d2c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:50.694613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b19c5a-8990-415c-8be5-173bbe60d2c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:50.695068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b19c5a-8990-415c-8be5-173bbe60d2c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:50.695494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6b19c5a-8990-415c-8be5-173bbe60d2c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:50.725074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6b19c5a-8990-415c-8be5-173bbe60d2c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Aug 22 19:26:50.725950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 431/881] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:50 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:51.246286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:51.246893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:51.253813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:51.254296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:51.254723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:51.255409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:51.255963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:51.256383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:51.315799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:51.323324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2b61fa5c-a158-43e5-90df-04f3e8ee5426 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080952 Aug 22 19:26:51.323931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 451/882] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:51 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:51.737813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa8b9d46-eeb4-4244-adfa-749565cefaa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:51.739966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa8b9d46-eeb4-4244-adfa-749565cefaa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:51.746314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d46-eeb4-4244-adfa-749565cefaa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:51.746801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d46-eeb4-4244-adfa-749565cefaa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:51.747227 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d46-eeb4-4244-adfa-749565cefaa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:51.747940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d46-eeb4-4244-adfa-749565cefaa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:51.748389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d46-eeb4-4244-adfa-749565cefaa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:51.748805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa8b9d46-eeb4-4244-adfa-749565cefaa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:51.776544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa8b9d46-eeb4-4244-adfa-749565cefaa0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Aug 22 19:26:51.777080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 432/883] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:51 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:52.343683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:52.344245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:52.350796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:52.351276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:52.351750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:52.352440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:52.352891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:52.353312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:52.413638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:52.421264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-031cc755-a343-4602-9e89-c979496f72ad tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081554 Aug 22 19:26:52.421820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 452/884] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:52 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:52.788703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30612335-b0ab-46ba-a394-77ae2661f90c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:52.790822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30612335-b0ab-46ba-a394-77ae2661f90c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:52.797720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30612335-b0ab-46ba-a394-77ae2661f90c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:52.798188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30612335-b0ab-46ba-a394-77ae2661f90c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:52.798612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30612335-b0ab-46ba-a394-77ae2661f90c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:52.799290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30612335-b0ab-46ba-a394-77ae2661f90c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:52.799762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30612335-b0ab-46ba-a394-77ae2661f90c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:52.800180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30612335-b0ab-46ba-a394-77ae2661f90c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:52.829644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30612335-b0ab-46ba-a394-77ae2661f90c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Aug 22 19:26:52.830202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 433/885] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:52 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:53.441461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:53.442081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:53.448541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:53.449030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:53.449469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:53.450164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:53.450622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:53.451051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:53.513949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:53.522090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8ac50084-e6ee-4e85-a114-a8586a1e0526 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084583 Aug 22 19:26:53.522641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 453/886] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:53 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:53.842147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0174359a-cd91-48a7-b63a-148e0b2cb8ec tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:53.844330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0174359a-cd91-48a7-b63a-148e0b2cb8ec tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:53.851080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0174359a-cd91-48a7-b63a-148e0b2cb8ec tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:53.851557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0174359a-cd91-48a7-b63a-148e0b2cb8ec tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:53.852056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0174359a-cd91-48a7-b63a-148e0b2cb8ec tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:53.852746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0174359a-cd91-48a7-b63a-148e0b2cb8ec tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:53.853199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0174359a-cd91-48a7-b63a-148e0b2cb8ec tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:53.853624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0174359a-cd91-48a7-b63a-148e0b2cb8ec tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:53.882135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0174359a-cd91-48a7-b63a-148e0b2cb8ec tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043974 Aug 22 19:26:53.882680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 434/887] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:53 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:54.543279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:54.543923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:54.550286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:54.550768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:54.551206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:54.551926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:54.552381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:54.552806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:54.614803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:54.622422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-06265c20-cd12-473a-84be-85f3381ff4a1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083099 Aug 22 19:26:54.622980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 454/888] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:54 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:54.893711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cbdb7944-b9fd-426f-985b-9535e5fd1626 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:54.895819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cbdb7944-b9fd-426f-985b-9535e5fd1626 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:54.902269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdb7944-b9fd-426f-985b-9535e5fd1626 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:54.902744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdb7944-b9fd-426f-985b-9535e5fd1626 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:54.903178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdb7944-b9fd-426f-985b-9535e5fd1626 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:54.903893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdb7944-b9fd-426f-985b-9535e5fd1626 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:54.904348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdb7944-b9fd-426f-985b-9535e5fd1626 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:54.904768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdb7944-b9fd-426f-985b-9535e5fd1626 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:54.933156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cbdb7944-b9fd-426f-985b-9535e5fd1626 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043512 Aug 22 19:26:54.933698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 435/889] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:54 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:55.643045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:55.643666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:55.650188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:55.650668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:55.651105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:55.651830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:55.652284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:55.652704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:55.711866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:55.719487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-06c146bf-2473-4c05-920c-8dd27d04bee8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080318 Aug 22 19:26:55.720070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 455/890] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:55 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:55.945890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0d4f051-eb42-40e5-a3ea-30bb5e8f7e67 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:55.948066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0d4f051-eb42-40e5-a3ea-30bb5e8f7e67 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:55.954437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0d4f051-eb42-40e5-a3ea-30bb5e8f7e67 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:55.954919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0d4f051-eb42-40e5-a3ea-30bb5e8f7e67 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:55.955356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0d4f051-eb42-40e5-a3ea-30bb5e8f7e67 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:55.956096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0d4f051-eb42-40e5-a3ea-30bb5e8f7e67 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:55.956555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0d4f051-eb42-40e5-a3ea-30bb5e8f7e67 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:55.956978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0d4f051-eb42-40e5-a3ea-30bb5e8f7e67 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:55.986106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0d4f051-eb42-40e5-a3ea-30bb5e8f7e67 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Aug 22 19:26:55.986635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 436/891] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:55 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:56.739438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:56.740097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:56.746685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:56.747164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:56.747595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:56.748306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:56.748754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:56.749175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:56.808386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:56.816290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-81639796-5883-4b47-8615-6d856bbba95b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080736 Aug 22 19:26:56.816845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 456/892] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:56 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:56.998133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60e06409-7701-4c8b-b4ba-4265179fbb0e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:57.000804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60e06409-7701-4c8b-b4ba-4265179fbb0e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:57.007077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e06409-7701-4c8b-b4ba-4265179fbb0e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:57.007560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e06409-7701-4c8b-b4ba-4265179fbb0e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:57.008026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e06409-7701-4c8b-b4ba-4265179fbb0e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:57.008746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e06409-7701-4c8b-b4ba-4265179fbb0e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:57.009201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e06409-7701-4c8b-b4ba-4265179fbb0e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:57.009626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e06409-7701-4c8b-b4ba-4265179fbb0e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:57.033948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:57.039220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60e06409-7701-4c8b-b4ba-4265179fbb0e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Aug 22 19:26:57.039785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 437/893] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:56 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:57.836227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:57.836817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:57.843174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:57.843663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:57.844765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:57.845449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:57.845896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:57.846315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:57.908606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:57.916295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f1f8bd81-ab34-4271-a62b-9b25695a97ef tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083905 Aug 22 19:26:57.916849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 457/894] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:57 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:58.051467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49bff8c9-ab22-430e-a041-7fdc51940dd7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:58.053611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49bff8c9-ab22-430e-a041-7fdc51940dd7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:58.059622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49bff8c9-ab22-430e-a041-7fdc51940dd7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:58.060128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49bff8c9-ab22-430e-a041-7fdc51940dd7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:58.060560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49bff8c9-ab22-430e-a041-7fdc51940dd7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:58.061247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49bff8c9-ab22-430e-a041-7fdc51940dd7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:58.061696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49bff8c9-ab22-430e-a041-7fdc51940dd7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:58.062117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49bff8c9-ab22-430e-a041-7fdc51940dd7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:58.090935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49bff8c9-ab22-430e-a041-7fdc51940dd7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Aug 22 19:26:58.091409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 438/895] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:58 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:26:58.936429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:58.937046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:58.943449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:58.943963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:58.944404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:58.945106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:58.945561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:58.945987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:58.963270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:26:59.007595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:26:59.015227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d398e4e7-6a6f-474a-88f3-327fb377083e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082631 Aug 22 19:26:59.015809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 458/896] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:26:58 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:26:59.103398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e2b7571-759a-48de-9b37-7508e572bb27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:26:59.105586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e2b7571-759a-48de-9b37-7508e572bb27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:26:59.112722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2b7571-759a-48de-9b37-7508e572bb27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:59.113205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2b7571-759a-48de-9b37-7508e572bb27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:59.113639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2b7571-759a-48de-9b37-7508e572bb27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:59.114336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2b7571-759a-48de-9b37-7508e572bb27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:26:59.114787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2b7571-759a-48de-9b37-7508e572bb27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:26:59.115207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2b7571-759a-48de-9b37-7508e572bb27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:26:59.143418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e2b7571-759a-48de-9b37-7508e572bb27 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043886 Aug 22 19:26:59.143997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 439/897] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:26:59 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:00.035578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:00.036256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:00.042582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:00.043055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:00.043485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:00.044196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:00.044641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:00.045059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:00.104483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:00.112606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3e1325cc-7134-4960-82c6-85d112659eda tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080858 Aug 22 19:27:00.113165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 459/898] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:00 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:00.155488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-271dfb0a-536b-41a3-be5c-cc96d32b73d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:00.157622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-271dfb0a-536b-41a3-be5c-cc96d32b73d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:00.164015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271dfb0a-536b-41a3-be5c-cc96d32b73d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:00.164485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271dfb0a-536b-41a3-be5c-cc96d32b73d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:00.164912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271dfb0a-536b-41a3-be5c-cc96d32b73d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:00.165592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271dfb0a-536b-41a3-be5c-cc96d32b73d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:00.166033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271dfb0a-536b-41a3-be5c-cc96d32b73d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:00.166449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-271dfb0a-536b-41a3-be5c-cc96d32b73d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:00.195181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-271dfb0a-536b-41a3-be5c-cc96d32b73d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 Aug 22 19:27:00.195746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 440/899] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:00 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:01.134013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:01.134617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:01.141042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:01.141536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:01.141975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:01.142666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:01.143123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:01.143547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:01.203365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:01.206393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4522cd89-168c-4882-a739-e199b7ab15d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:01.208791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4522cd89-168c-4882-a739-e199b7ab15d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:01.211254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c785d3f7-3c1b-4064-abb2-dd94d324d5e9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081082 Aug 22 19:27:01.212039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 460/900] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:01 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:01.215236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522cd89-168c-4882-a739-e199b7ab15d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:01.215752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522cd89-168c-4882-a739-e199b7ab15d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:01.216184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522cd89-168c-4882-a739-e199b7ab15d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:01.216916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522cd89-168c-4882-a739-e199b7ab15d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:01.217361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522cd89-168c-4882-a739-e199b7ab15d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:01.217778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522cd89-168c-4882-a739-e199b7ab15d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:01.247563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4522cd89-168c-4882-a739-e199b7ab15d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Aug 22 19:27:01.248143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 441/901] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:01 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:02.232314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:02.232929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:02.239623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:02.240130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:02.240563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:02.241244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:02.241691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:02.242107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:02.259584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42930c7f-76b0-4ba5-bd7a-cde151a0c341 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:02.261749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42930c7f-76b0-4ba5-bd7a-cde151a0c341 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:02.267944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42930c7f-76b0-4ba5-bd7a-cde151a0c341 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:02.268418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42930c7f-76b0-4ba5-bd7a-cde151a0c341 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:02.268846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42930c7f-76b0-4ba5-bd7a-cde151a0c341 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:02.269538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42930c7f-76b0-4ba5-bd7a-cde151a0c341 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:02.269982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42930c7f-76b0-4ba5-bd7a-cde151a0c341 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:02.270418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42930c7f-76b0-4ba5-bd7a-cde151a0c341 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:02.300728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42930c7f-76b0-4ba5-bd7a-cde151a0c341 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Aug 22 19:27:02.301314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 442/902] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:02 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:02.306368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:02.314061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-85c9c5cf-f1c5-4ca0-90da-9cebe3cb049c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.085668 Aug 22 19:27:02.314608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 461/903] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:02 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:03.313705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd4826f3-182e-4a27-84c2-7334ff4779b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:03.315858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd4826f3-182e-4a27-84c2-7334ff4779b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:03.322178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4826f3-182e-4a27-84c2-7334ff4779b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:03.322662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4826f3-182e-4a27-84c2-7334ff4779b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:03.323090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4826f3-182e-4a27-84c2-7334ff4779b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:03.323811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4826f3-182e-4a27-84c2-7334ff4779b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:03.324265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4826f3-182e-4a27-84c2-7334ff4779b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:03.324687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd4826f3-182e-4a27-84c2-7334ff4779b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:03.334139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:03.334881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:03.341201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:03.341678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:03.342109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:03.342798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:03.343250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:03.343688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:03.353648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd4826f3-182e-4a27-84c2-7334ff4779b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Aug 22 19:27:03.354218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 443/904] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:03 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:03.405107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:03.413415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6fb024ca-3c38-4152-b55e-b2295e5d5d76 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083102 Aug 22 19:27:03.413979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 462/905] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:03 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:27:04.366560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2dcfcd24-a5d8-4594-ad6e-a6a7b230171f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:04.368772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2dcfcd24-a5d8-4594-ad6e-a6a7b230171f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:04.375266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dcfcd24-a5d8-4594-ad6e-a6a7b230171f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:04.375782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dcfcd24-a5d8-4594-ad6e-a6a7b230171f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:04.376219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dcfcd24-a5d8-4594-ad6e-a6a7b230171f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:04.376910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dcfcd24-a5d8-4594-ad6e-a6a7b230171f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:04.377361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dcfcd24-a5d8-4594-ad6e-a6a7b230171f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:04.377783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dcfcd24-a5d8-4594-ad6e-a6a7b230171f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:04.406002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2dcfcd24-a5d8-4594-ad6e-a6a7b230171f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043374 Aug 22 19:27:04.406996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 444/906] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:04 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:04.433448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:04.434056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:04.440577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:04.441051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:04.441481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:04.442157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:04.442600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:04.443018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:04.502412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:04.509859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-64be7b08-6b3a-49ca-b0d8-8c9ff4ac2f3f tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080249 Aug 22 19:27:04.510410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 463/907] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:04 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:05.418399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86ba213d-540b-400b-b970-bd4a0913aff9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:05.420558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86ba213d-540b-400b-b970-bd4a0913aff9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:05.427553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ba213d-540b-400b-b970-bd4a0913aff9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:05.428079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ba213d-540b-400b-b970-bd4a0913aff9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:05.428515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ba213d-540b-400b-b970-bd4a0913aff9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:05.429221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ba213d-540b-400b-b970-bd4a0913aff9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:05.429673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ba213d-540b-400b-b970-bd4a0913aff9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:05.430095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ba213d-540b-400b-b970-bd4a0913aff9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:05.459886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86ba213d-540b-400b-b970-bd4a0913aff9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Aug 22 19:27:05.460456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 445/908] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:05 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:05.529162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:05.529774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:05.536329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:05.536815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:05.537253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:05.537950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:05.538410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:05.538838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:05.598863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:05.606525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7f49ce76-27a8-40a3-84ea-e78c0afb146b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081173 Aug 22 19:27:05.607088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 464/909] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:05 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:06.472988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21fd10b4-2a4b-4230-b491-6198918a1305 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:06.475126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21fd10b4-2a4b-4230-b491-6198918a1305 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:06.481540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21fd10b4-2a4b-4230-b491-6198918a1305 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:06.482025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21fd10b4-2a4b-4230-b491-6198918a1305 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:06.482464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21fd10b4-2a4b-4230-b491-6198918a1305 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:06.483160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21fd10b4-2a4b-4230-b491-6198918a1305 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:06.483613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21fd10b4-2a4b-4230-b491-6198918a1305 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:06.484072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21fd10b4-2a4b-4230-b491-6198918a1305 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:06.512648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21fd10b4-2a4b-4230-b491-6198918a1305 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Aug 22 19:27:06.513186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 446/910] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:06 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:06.627204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:06.627847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:06.634336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:06.634818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:06.635256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:06.635991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:06.636441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:06.636864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:06.698919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:06.706583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-95a32bb3-41f1-4a93-823e-3c1a990b5eb1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083204 Aug 22 19:27:06.707143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 465/911] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:06 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:07.524821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78f1a1c9-1b1a-4f4b-adc0-61de4611e255 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:07.526937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78f1a1c9-1b1a-4f4b-adc0-61de4611e255 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:07.533259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f1a1c9-1b1a-4f4b-adc0-61de4611e255 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:07.533734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f1a1c9-1b1a-4f4b-adc0-61de4611e255 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:07.534176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f1a1c9-1b1a-4f4b-adc0-61de4611e255 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:07.534837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f1a1c9-1b1a-4f4b-adc0-61de4611e255 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:07.535282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f1a1c9-1b1a-4f4b-adc0-61de4611e255 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:07.535721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78f1a1c9-1b1a-4f4b-adc0-61de4611e255 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:07.564524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78f1a1c9-1b1a-4f4b-adc0-61de4611e255 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042982 Aug 22 19:27:07.565063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 447/912] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:07 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:07.726635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:07.727243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:07.733643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:07.734120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:07.734550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:07.735237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:07.736586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:07.737018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:07.799853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:07.807814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-13ef543a-ffaa-4e07-96f7-32f7b3b3f4d3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084999 Aug 22 19:27:07.808376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 466/913] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:07 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:08.576580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50e52150-1bf2-405d-aef4-3e456adfc021 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:08.578691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50e52150-1bf2-405d-aef4-3e456adfc021 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:08.585036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e52150-1bf2-405d-aef4-3e456adfc021 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:08.585513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e52150-1bf2-405d-aef4-3e456adfc021 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:08.585942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e52150-1bf2-405d-aef4-3e456adfc021 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:08.586621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e52150-1bf2-405d-aef4-3e456adfc021 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:08.587067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e52150-1bf2-405d-aef4-3e456adfc021 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:08.587488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50e52150-1bf2-405d-aef4-3e456adfc021 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:08.616055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50e52150-1bf2-405d-aef4-3e456adfc021 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 Aug 22 19:27:08.616597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 448/914] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:08 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:08.828741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:08.829306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:08.835607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:08.836112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:08.836543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:08.837226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:08.837673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:08.838092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:08.900235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:08.907779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e1e12f1b-9bb1-46d4-834e-3b3013074d96 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083000 Aug 22 19:27:08.908336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 467/915] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:08 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:09.629007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a4d96d6-a8fd-4df5-a0a1-1093724bb9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:09.631191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6a4d96d6-a8fd-4df5-a0a1-1093724bb9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:09.637546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a4d96d6-a8fd-4df5-a0a1-1093724bb9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:09.638020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a4d96d6-a8fd-4df5-a0a1-1093724bb9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:09.638451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a4d96d6-a8fd-4df5-a0a1-1093724bb9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:09.639133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a4d96d6-a8fd-4df5-a0a1-1093724bb9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:09.639580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a4d96d6-a8fd-4df5-a0a1-1093724bb9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:09.640028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a4d96d6-a8fd-4df5-a0a1-1093724bb9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:09.669245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a4d96d6-a8fd-4df5-a0a1-1093724bb9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Aug 22 19:27:09.669790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 449/916] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:09 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:09.928407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:09.929014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:09.935421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:09.935938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:09.936376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:09.937069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:09.937521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:09.937944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:09.997024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:10.005432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7c11f200-4d69-4933-ad43-204e3b252f12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080887 Aug 22 19:27:10.005990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 468/917] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:09 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:10.681810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d1a2af5-8246-483e-8a95-ec1fd03aa855 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:10.683987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d1a2af5-8246-483e-8a95-ec1fd03aa855 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:10.691078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1a2af5-8246-483e-8a95-ec1fd03aa855 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:10.691554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1a2af5-8246-483e-8a95-ec1fd03aa855 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:10.692016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1a2af5-8246-483e-8a95-ec1fd03aa855 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:10.692698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1a2af5-8246-483e-8a95-ec1fd03aa855 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:10.693146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1a2af5-8246-483e-8a95-ec1fd03aa855 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:10.693564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d1a2af5-8246-483e-8a95-ec1fd03aa855 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:10.721366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d1a2af5-8246-483e-8a95-ec1fd03aa855 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043491 Aug 22 19:27:10.722168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 450/918] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:10 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:11.025081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:11.025634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:11.032049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:11.033034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:11.033464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:11.034139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:11.034582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:11.035002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:11.098280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:11.105904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b9bf5ca5-1da6-4f3d-8db4-c9995a6a0e98 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084758 Aug 22 19:27:11.106456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 469/919] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:11 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:11.733592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d44ff5d0-3359-4841-bba0-2ea22f35e401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:11.736373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d44ff5d0-3359-4841-bba0-2ea22f35e401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:11.738630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=58 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:11.743809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d44ff5d0-3359-4841-bba0-2ea22f35e401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:11.744284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d44ff5d0-3359-4841-bba0-2ea22f35e401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:11.744713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d44ff5d0-3359-4841-bba0-2ea22f35e401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:11.745403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d44ff5d0-3359-4841-bba0-2ea22f35e401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:11.745850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d44ff5d0-3359-4841-bba0-2ea22f35e401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:11.746299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d44ff5d0-3359-4841-bba0-2ea22f35e401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:11.774465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d44ff5d0-3359-4841-bba0-2ea22f35e401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Aug 22 19:27:11.775006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 451/920] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:11 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:12.127100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:12.127686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:12.129970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=56 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:12.135158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:12.135662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:12.136096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:12.136786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:12.137263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:12.137688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:12.197783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:12.205860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a0c168c6-135b-4c5a-b740-98bea3d9dcb0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082676 Aug 22 19:27:12.206429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 470/921] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:12 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:12.786750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09c33d50-2085-4cd1-b447-c01fefd37458 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:12.788936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09c33d50-2085-4cd1-b447-c01fefd37458 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:12.795243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c33d50-2085-4cd1-b447-c01fefd37458 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:12.795761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c33d50-2085-4cd1-b447-c01fefd37458 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:12.796197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c33d50-2085-4cd1-b447-c01fefd37458 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:12.796885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c33d50-2085-4cd1-b447-c01fefd37458 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:12.797339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c33d50-2085-4cd1-b447-c01fefd37458 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:12.797764 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c33d50-2085-4cd1-b447-c01fefd37458 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:12.826706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09c33d50-2085-4cd1-b447-c01fefd37458 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Aug 22 19:27:12.827243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 452/922] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:12 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:13.226445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:13.227059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:13.233534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:13.234015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:13.234479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:13.235169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:13.236453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:13.236881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:13.296059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:13.304402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-43b36d35-a87e-42d8-8015-2957b0230c60 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081851 Aug 22 19:27:13.304958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 471/923] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:13 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:13.838849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34e2e944-0d19-4b86-8464-ad31a54cbbe9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:13.840995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34e2e944-0d19-4b86-8464-ad31a54cbbe9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:13.847593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34e2e944-0d19-4b86-8464-ad31a54cbbe9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:13.848095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34e2e944-0d19-4b86-8464-ad31a54cbbe9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:13.848525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34e2e944-0d19-4b86-8464-ad31a54cbbe9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:13.849214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34e2e944-0d19-4b86-8464-ad31a54cbbe9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:13.849659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34e2e944-0d19-4b86-8464-ad31a54cbbe9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:13.850078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34e2e944-0d19-4b86-8464-ad31a54cbbe9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:13.878807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34e2e944-0d19-4b86-8464-ad31a54cbbe9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043910 Aug 22 19:27:13.879363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 453/924] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:14.324818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:14.325459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:14.332457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:14.332938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:14.333376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:14.334066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:14.334518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:14.334941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:14.394967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:14.402702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e1ee860c-2017-4dce-bde5-8d6bdd482555 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081702 Aug 22 19:27:14.403196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 472/925] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:14 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:14.891113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08c20f1d-4cc7-41a6-9dbe-f3aeef65f79c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:14.893877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08c20f1d-4cc7-41a6-9dbe-f3aeef65f79c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:14.900361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08c20f1d-4cc7-41a6-9dbe-f3aeef65f79c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:14.900842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08c20f1d-4cc7-41a6-9dbe-f3aeef65f79c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:14.901272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08c20f1d-4cc7-41a6-9dbe-f3aeef65f79c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:14.901960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08c20f1d-4cc7-41a6-9dbe-f3aeef65f79c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:14.902411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08c20f1d-4cc7-41a6-9dbe-f3aeef65f79c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:14.902835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08c20f1d-4cc7-41a6-9dbe-f3aeef65f79c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:14.919424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:14.932598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08c20f1d-4cc7-41a6-9dbe-f3aeef65f79c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045532 Aug 22 19:27:14.933158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 454/926] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:15.424446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:15.425071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:15.431326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:15.431836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:15.432269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:15.432953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:15.433396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:15.433815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:15.496361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:15.504018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b235e9bf-bd89-48e8-b7a2-33911089a24c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084096 Aug 22 19:27:15.504571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 473/927] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:15 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:15.944504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e926a720-8c9d-4b6d-919e-304cbdd4809b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:15.946983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e926a720-8c9d-4b6d-919e-304cbdd4809b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:15.953299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e926a720-8c9d-4b6d-919e-304cbdd4809b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:15.953769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e926a720-8c9d-4b6d-919e-304cbdd4809b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:15.954692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e926a720-8c9d-4b6d-919e-304cbdd4809b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:15.955371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e926a720-8c9d-4b6d-919e-304cbdd4809b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:15.955855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e926a720-8c9d-4b6d-919e-304cbdd4809b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:15.956267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e926a720-8c9d-4b6d-919e-304cbdd4809b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:15.984857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e926a720-8c9d-4b6d-919e-304cbdd4809b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Aug 22 19:27:15.985412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 455/928] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:16.524327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:16.524937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:16.531471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:16.531988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:16.532421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:16.533153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:16.533600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:16.534018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:16.595156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:16.603166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-325c2f67-65e5-4a6f-8fc8-33791f834c61 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082663 Aug 22 19:27:16.603735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 474/929] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:16 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:16.996979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65797b4a-1d1a-4d05-9409-bb0df7a38035 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:16.999097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65797b4a-1d1a-4d05-9409-bb0df7a38035 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:17.005478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65797b4a-1d1a-4d05-9409-bb0df7a38035 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:17.005954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65797b4a-1d1a-4d05-9409-bb0df7a38035 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:17.006384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65797b4a-1d1a-4d05-9409-bb0df7a38035 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:17.007066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65797b4a-1d1a-4d05-9409-bb0df7a38035 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:17.007511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65797b4a-1d1a-4d05-9409-bb0df7a38035 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:17.007956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65797b4a-1d1a-4d05-9409-bb0df7a38035 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:17.036182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65797b4a-1d1a-4d05-9409-bb0df7a38035 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Aug 22 19:27:17.036729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 456/930] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:17.623988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:17.624529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:17.631623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:17.632130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:17.632565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:17.633255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:17.633707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:17.634135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:17.638076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:17.694419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:17.702044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-23a59128-8b6e-4cd5-8bd6-2458468bdebb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082019 Aug 22 19:27:17.702601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 475/931] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:17 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:18.048518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03222ae9-9629-4e79-936d-c4de85f01f2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:18.050670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-03222ae9-9629-4e79-936d-c4de85f01f2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:18.056971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03222ae9-9629-4e79-936d-c4de85f01f2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:18.057450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03222ae9-9629-4e79-936d-c4de85f01f2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:18.057893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03222ae9-9629-4e79-936d-c4de85f01f2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:18.058579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03222ae9-9629-4e79-936d-c4de85f01f2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:18.059030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03222ae9-9629-4e79-936d-c4de85f01f2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:18.059450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03222ae9-9629-4e79-936d-c4de85f01f2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:18.087856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-03222ae9-9629-4e79-936d-c4de85f01f2c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043235 Aug 22 19:27:18.088395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 457/932] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:18.722564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:18.723347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:18.729819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:18.730331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:18.730769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:18.731458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:18.731949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:18.732375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:18.792470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:18.802188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e6931997-c106-4bb0-969a-9d007b513780 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083718 Aug 22 19:27:18.802776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 476/933] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:18 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:19.100387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b55dc46f-1a3b-437a-849b-b9b510258f90 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:19.102472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b55dc46f-1a3b-437a-849b-b9b510258f90 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:19.109388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55dc46f-1a3b-437a-849b-b9b510258f90 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:19.109917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55dc46f-1a3b-437a-849b-b9b510258f90 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:19.110960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55dc46f-1a3b-437a-849b-b9b510258f90 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:19.111717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55dc46f-1a3b-437a-849b-b9b510258f90 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:19.112239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55dc46f-1a3b-437a-849b-b9b510258f90 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:19.112725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55dc46f-1a3b-437a-849b-b9b510258f90 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:19.142557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b55dc46f-1a3b-437a-849b-b9b510258f90 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046523 Aug 22 19:27:19.143116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 458/934] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:19 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:19.822270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:19.822890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:19.829861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:19.830344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:19.830800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:19.831470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:19.831950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:19.832378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:19.900368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:19.912069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3e81ff44-9795-4578-a253-c0c93e147913 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.093229 Aug 22 19:27:19.913085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 477/935] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:19 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:20.154467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-211d81d0-8a88-4ea7-9c02-069c128e8e46 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:20.156714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-211d81d0-8a88-4ea7-9c02-069c128e8e46 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:20.163160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-211d81d0-8a88-4ea7-9c02-069c128e8e46 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:20.163653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-211d81d0-8a88-4ea7-9c02-069c128e8e46 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:20.164106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-211d81d0-8a88-4ea7-9c02-069c128e8e46 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:20.164799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-211d81d0-8a88-4ea7-9c02-069c128e8e46 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:20.165250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-211d81d0-8a88-4ea7-9c02-069c128e8e46 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:20.165676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-211d81d0-8a88-4ea7-9c02-069c128e8e46 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:20.195102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-211d81d0-8a88-4ea7-9c02-069c128e8e46 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Aug 22 19:27:20.195893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 459/936] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:20 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:20.932600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:20.933208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:20.939549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:20.940056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:20.940486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:20.941161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:20.941607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:20.942023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:21.001477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:21.009111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b8b37e4c-629c-4c39-ac6f-004db744ca27 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080354 Aug 22 19:27:21.009669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 478/937] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:20 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:21.207217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b4b7aad4-2e56-4814-926b-632da673d7d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:21.209429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b4b7aad4-2e56-4814-926b-632da673d7d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:21.215790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4b7aad4-2e56-4814-926b-632da673d7d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:21.216270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4b7aad4-2e56-4814-926b-632da673d7d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:21.216705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4b7aad4-2e56-4814-926b-632da673d7d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:21.217392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4b7aad4-2e56-4814-926b-632da673d7d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:21.217840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4b7aad4-2e56-4814-926b-632da673d7d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:21.218262 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4b7aad4-2e56-4814-926b-632da673d7d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:21.248771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b4b7aad4-2e56-4814-926b-632da673d7d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045682 Aug 22 19:27:21.249547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 460/938] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:22.029531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:22.030150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:22.037125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:22.037609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:22.038048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:22.038740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:22.039193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:22.039621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:22.099552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:22.107303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c8a794b8-d7cb-4f2d-9cfb-dea250d5a076 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081621 Aug 22 19:27:22.107899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 479/939] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:22 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:22.260146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d292bf7f-04b6-41d9-90d6-dc29e25a98a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:22.262214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d292bf7f-04b6-41d9-90d6-dc29e25a98a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:22.268571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d292bf7f-04b6-41d9-90d6-dc29e25a98a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:22.269046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d292bf7f-04b6-41d9-90d6-dc29e25a98a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:22.269474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d292bf7f-04b6-41d9-90d6-dc29e25a98a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:22.270154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d292bf7f-04b6-41d9-90d6-dc29e25a98a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:22.270598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d292bf7f-04b6-41d9-90d6-dc29e25a98a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:22.271021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d292bf7f-04b6-41d9-90d6-dc29e25a98a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:22.300249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d292bf7f-04b6-41d9-90d6-dc29e25a98a0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Aug 22 19:27:22.300788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 461/940] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:23.127775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:23.128498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:23.134905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:23.135384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:23.135862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:23.136550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:23.137004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:23.137427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:23.199370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:23.207907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-34fa5aea-2925-434c-a56a-23296af295ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084357 Aug 22 19:27:23.208474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 480/941] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:23 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:23.312031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-973e8fef-315b-42a8-afeb-c9d339593564 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:23.314868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-973e8fef-315b-42a8-afeb-c9d339593564 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:23.321310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-973e8fef-315b-42a8-afeb-c9d339593564 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:23.321792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-973e8fef-315b-42a8-afeb-c9d339593564 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:23.322233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-973e8fef-315b-42a8-afeb-c9d339593564 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:23.322928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-973e8fef-315b-42a8-afeb-c9d339593564 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:23.323381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-973e8fef-315b-42a8-afeb-c9d339593564 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:23.323841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-973e8fef-315b-42a8-afeb-c9d339593564 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:23.352102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-973e8fef-315b-42a8-afeb-c9d339593564 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Aug 22 19:27:23.352653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 462/942] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:24.228469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:24.229083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:24.235434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:24.235944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:24.236379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:24.237068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:24.237520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:24.237945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:24.299948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:24.307476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-58055338-63fd-4b92-995b-2f5b69f1e7e0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082920 Aug 22 19:27:24.308074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 481/943] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:24 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:24.364317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e18acca0-1b24-4c35-accc-af2b9003c391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:24.366446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e18acca0-1b24-4c35-accc-af2b9003c391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:24.372861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e18acca0-1b24-4c35-accc-af2b9003c391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:24.373344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e18acca0-1b24-4c35-accc-af2b9003c391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:24.373815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e18acca0-1b24-4c35-accc-af2b9003c391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:24.374509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e18acca0-1b24-4c35-accc-af2b9003c391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:24.374965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e18acca0-1b24-4c35-accc-af2b9003c391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:24.375391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e18acca0-1b24-4c35-accc-af2b9003c391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:24.404634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e18acca0-1b24-4c35-accc-af2b9003c391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Aug 22 19:27:24.405106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 463/944] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:25.327895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:25.328617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:25.335090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:25.335564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:25.336026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:25.336708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:25.337153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:25.337598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:25.397407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:25.404860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a9b49c0f-78b8-44aa-a2b1-8f4de86e4e74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080838 Aug 22 19:27:25.405415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 482/945] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:25 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:25.416646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93fdb102-de47-4cb4-b2ce-3f7a75133f9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:25.418793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93fdb102-de47-4cb4-b2ce-3f7a75133f9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:25.425901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93fdb102-de47-4cb4-b2ce-3f7a75133f9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:25.426383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93fdb102-de47-4cb4-b2ce-3f7a75133f9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:25.426820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93fdb102-de47-4cb4-b2ce-3f7a75133f9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:25.427513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93fdb102-de47-4cb4-b2ce-3f7a75133f9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:25.428046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93fdb102-de47-4cb4-b2ce-3f7a75133f9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:25.428469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93fdb102-de47-4cb4-b2ce-3f7a75133f9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:25.456265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93fdb102-de47-4cb4-b2ce-3f7a75133f9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Aug 22 19:27:25.456813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 464/946] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:25 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:26.426291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:26.426843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:26.433200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:26.433683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:26.434117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:26.434801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:26.435254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:26.435706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:26.468446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5bbd9b44-7201-4ba0-8c40-a93edfc2c5bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:26.470631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5bbd9b44-7201-4ba0-8c40-a93edfc2c5bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:26.477266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bbd9b44-7201-4ba0-8c40-a93edfc2c5bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:26.477740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bbd9b44-7201-4ba0-8c40-a93edfc2c5bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:26.478167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bbd9b44-7201-4ba0-8c40-a93edfc2c5bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:26.478863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bbd9b44-7201-4ba0-8c40-a93edfc2c5bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:26.479305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bbd9b44-7201-4ba0-8c40-a93edfc2c5bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:26.479749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bbd9b44-7201-4ba0-8c40-a93edfc2c5bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:26.496463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:26.504773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-828e8a59-4813-48b8-a7b3-e1fec08c6e8a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082924 Aug 22 19:27:26.505334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 483/947] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:26 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:26.510383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5bbd9b44-7201-4ba0-8c40-a93edfc2c5bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Aug 22 19:27:26.510928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 465/948] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:26 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:27.523614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-812103a1-1d53-414d-8ebb-36fd4f297abb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:27.524441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:27.525047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:27.525758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-812103a1-1d53-414d-8ebb-36fd4f297abb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:27.531675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:27.532125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812103a1-1d53-414d-8ebb-36fd4f297abb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:27.532276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:27.532600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:27.532710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812103a1-1d53-414d-8ebb-36fd4f297abb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:27.533031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812103a1-1d53-414d-8ebb-36fd4f297abb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:27.533283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:27.533720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812103a1-1d53-414d-8ebb-36fd4f297abb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:27.533821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:27.534133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:27.534232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812103a1-1d53-414d-8ebb-36fd4f297abb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:27.534582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-812103a1-1d53-414d-8ebb-36fd4f297abb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:27.563075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-812103a1-1d53-414d-8ebb-36fd4f297abb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Aug 22 19:27:27.564151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 484/949] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:27.595819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:27.603695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a908023f-6b07-4619-a779-09de7bf1e47a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082949 Aug 22 19:27:27.604260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 466/950] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:27 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:27:28.575382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e09ff8dc-4b03-4806-8ad5-531d1044a4c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:28.577578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e09ff8dc-4b03-4806-8ad5-531d1044a4c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:28.584285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e09ff8dc-4b03-4806-8ad5-531d1044a4c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:28.584769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e09ff8dc-4b03-4806-8ad5-531d1044a4c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:28.585207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e09ff8dc-4b03-4806-8ad5-531d1044a4c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:28.585907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e09ff8dc-4b03-4806-8ad5-531d1044a4c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:28.586392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e09ff8dc-4b03-4806-8ad5-531d1044a4c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:28.586817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e09ff8dc-4b03-4806-8ad5-531d1044a4c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:28.617169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e09ff8dc-4b03-4806-8ad5-531d1044a4c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 Aug 22 19:27:28.617936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 485/951] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:28.624347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:28.625206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:28.631920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:28.632517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:28.632827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:28.633701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:28.634328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:28.634933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:28.713625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1158997264"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:27:28.713803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:28.714610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:28.721002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:28.721790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7a337de-9ab6-40b9-b9ca-c50477425d8d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.100970 Aug 22 19:27:28.722127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:28.722555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 467/952] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:28 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:28.722729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:28.723614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:28.724186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:28.724686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:28.853774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.network.security_group_api [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Removing security group 2c406cf5-f685-4b77-aae9-993b9bb015f7 from port 23337ac5-214c-419d-b22b-ad62bd9b3776 Aug 22 19:27:29.192271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1a15a568-40cb-4f91-a492-7b90fc69d22c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/action" status: 202 len: 0 microversion: 2.1 time: 0.482892 Aug 22 19:27:29.196195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 486/953] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:27:28 2022] POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 19:27:29.204640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e68d80cc-0150-4363-934d-a3dd87e33f27 req-e41a181c-2b57-4767-b7eb-f0ab4086b92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9698a0b1-a98a-40e1-9093-39946273a155", "tag": "23337ac5-214c-419d-b22b-ad62bd9b3776"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:27:29.217997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e68d80cc-0150-4363-934d-a3dd87e33f27 req-e41a181c-2b57-4767-b7eb-f0ab4086b92a service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:29.218728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e68d80cc-0150-4363-934d-a3dd87e33f27 req-e41a181c-2b57-4767-b7eb-f0ab4086b92a service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:29.219415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e68d80cc-0150-4363-934d-a3dd87e33f27 req-e41a181c-2b57-4767-b7eb-f0ab4086b92a service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:29.280450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e68d80cc-0150-4363-934d-a3dd87e33f27 req-e41a181c-2b57-4767-b7eb-f0ab4086b92a service nova] Creating event network-changed:23337ac5-214c-419d-b22b-ad62bd9b3776 for instance 9698a0b1-a98a-40e1-9093-39946273a155 on hv-cinder-83538 Aug 22 19:27:29.290854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e68d80cc-0150-4363-934d-a3dd87e33f27 req-e41a181c-2b57-4767-b7eb-f0ab4086b92a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089754 Aug 22 19:27:29.292041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 468/954] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:29.631549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-45ccfe37-9668-47a0-9c39-7ac7d53929bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:29.634484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-45ccfe37-9668-47a0-9c39-7ac7d53929bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:29.643373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ccfe37-9668-47a0-9c39-7ac7d53929bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:29.644153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ccfe37-9668-47a0-9c39-7ac7d53929bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:29.644581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ccfe37-9668-47a0-9c39-7ac7d53929bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:29.645609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ccfe37-9668-47a0-9c39-7ac7d53929bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:29.646224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ccfe37-9668-47a0-9c39-7ac7d53929bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:29.646988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ccfe37-9668-47a0-9c39-7ac7d53929bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:29.679353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-45ccfe37-9668-47a0-9c39-7ac7d53929bd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052125 Aug 22 19:27:29.680566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 487/955] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:27:29.744911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:29.745767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:29.760588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:29.761345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:29.761791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:29.765138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:29.765787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:29.766284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:29.878439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:29.886885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49e3d03e-0e33-4dc4-9d45-85c77d0b7798 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.147483 Aug 22 19:27:29.887514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 469/956] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:29 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:30.551696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:30.552262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:30.558570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:30.559124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:30.559560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:30.560280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:30.560728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:30.561147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:30.690989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf69375d-df43-4251-813d-19d2ecac54b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:30.693289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf69375d-df43-4251-813d-19d2ecac54b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:30.699167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf69375d-df43-4251-813d-19d2ecac54b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:30.699668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf69375d-df43-4251-813d-19d2ecac54b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:30.700114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf69375d-df43-4251-813d-19d2ecac54b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:30.700810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf69375d-df43-4251-813d-19d2ecac54b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:30.701260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf69375d-df43-4251-813d-19d2ecac54b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:30.701682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf69375d-df43-4251-813d-19d2ecac54b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:30.731222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf69375d-df43-4251-813d-19d2ecac54b0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Aug 22 19:27:30.731798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 470/957] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:30 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:30.908680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:30.909430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:30.915743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:30.916232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:30.916669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:30.917367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:30.917829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:30.918248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:30.983044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:30.987021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:30.992540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8033dcd3-9e87-4cb6-b3ae-a7e67e8c766d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.088257 Aug 22 19:27:30.993113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 471/958] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:30 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:27:31.306302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-364bdd3f-836a-4017-8fda-3912ec1471c3 req-aef8d85b-38bd-4009-bb6a-a3eeab2326df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9698a0b1-a98a-40e1-9093-39946273a155", "tag": "23337ac5-214c-419d-b22b-ad62bd9b3776"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:27:31.316408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-364bdd3f-836a-4017-8fda-3912ec1471c3 req-aef8d85b-38bd-4009-bb6a-a3eeab2326df service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:31.316964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-364bdd3f-836a-4017-8fda-3912ec1471c3 req-aef8d85b-38bd-4009-bb6a-a3eeab2326df service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:31.317464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-364bdd3f-836a-4017-8fda-3912ec1471c3 req-aef8d85b-38bd-4009-bb6a-a3eeab2326df service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:31.329806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-364bdd3f-836a-4017-8fda-3912ec1471c3 req-aef8d85b-38bd-4009-bb6a-a3eeab2326df service nova] Creating event network-changed:23337ac5-214c-419d-b22b-ad62bd9b3776 for instance 9698a0b1-a98a-40e1-9093-39946273a155 on hv-cinder-83538 Aug 22 19:27:31.334667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-364bdd3f-836a-4017-8fda-3912ec1471c3 req-aef8d85b-38bd-4009-bb6a-a3eeab2326df service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032233 Aug 22 19:27:31.335330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 472/959] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:31.744193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55230f1c-b9c3-427b-b5fe-851c2b9e5574 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:31.746375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55230f1c-b9c3-427b-b5fe-851c2b9e5574 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:31.753176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55230f1c-b9c3-427b-b5fe-851c2b9e5574 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:31.753658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55230f1c-b9c3-427b-b5fe-851c2b9e5574 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:31.754091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55230f1c-b9c3-427b-b5fe-851c2b9e5574 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:31.754840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55230f1c-b9c3-427b-b5fe-851c2b9e5574 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:31.755295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55230f1c-b9c3-427b-b5fe-851c2b9e5574 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:31.755748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55230f1c-b9c3-427b-b5fe-851c2b9e5574 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:31.784342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55230f1c-b9c3-427b-b5fe-851c2b9e5574 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Aug 22 19:27:31.785115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 473/960] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:32.013524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:32.014197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:32.020379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:32.020863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:32.021300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:32.021987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:32.022441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:32.022864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:32.085834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:32.093454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-314eb38c-b7eb-4a1b-9205-1f9b03970c21 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083833 Aug 22 19:27:32.094041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 474/961] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:32 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:27:32.796837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84194323-a05a-43f3-9b91-50a117a38396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:32.799847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84194323-a05a-43f3-9b91-50a117a38396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:32.805803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84194323-a05a-43f3-9b91-50a117a38396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:32.806284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84194323-a05a-43f3-9b91-50a117a38396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:32.806722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84194323-a05a-43f3-9b91-50a117a38396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:32.807411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84194323-a05a-43f3-9b91-50a117a38396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:32.807902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84194323-a05a-43f3-9b91-50a117a38396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:32.808332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84194323-a05a-43f3-9b91-50a117a38396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:32.836207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84194323-a05a-43f3-9b91-50a117a38396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043407 Aug 22 19:27:32.836745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 475/962] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:33.114833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:33.115483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:33.121823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:33.122295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:33.122723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:33.123402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:33.123883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:33.124298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:33.188226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:33.196092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c2f119b-1343-4b85-a821-e190758342f0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.085332 Aug 22 19:27:33.196659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 476/963] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:33 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:27:33.849395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f37c8e57-5bd1-4017-8038-a0336fb7314a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:33.851541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f37c8e57-5bd1-4017-8038-a0336fb7314a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:33.857424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f37c8e57-5bd1-4017-8038-a0336fb7314a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:33.857899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f37c8e57-5bd1-4017-8038-a0336fb7314a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:33.858328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f37c8e57-5bd1-4017-8038-a0336fb7314a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:33.859009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f37c8e57-5bd1-4017-8038-a0336fb7314a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:33.859456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f37c8e57-5bd1-4017-8038-a0336fb7314a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:33.859943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f37c8e57-5bd1-4017-8038-a0336fb7314a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:33.887316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f37c8e57-5bd1-4017-8038-a0336fb7314a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042765 Aug 22 19:27:33.887890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 477/964] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:33 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:34.217990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:34.218767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:34.225325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:34.225804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:34.226232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:34.226914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:34.227363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:34.227821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:34.287816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:34.295427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b156bf3-80f7-4e5a-ad35-5ca2b3d43419 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081689 Aug 22 19:27:34.296047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 478/965] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:34 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:34.900070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2ac7d3fa-e141-4966-b517-eeed275fd14c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:34.902191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2ac7d3fa-e141-4966-b517-eeed275fd14c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:34.908599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ac7d3fa-e141-4966-b517-eeed275fd14c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:34.909083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ac7d3fa-e141-4966-b517-eeed275fd14c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:34.909519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ac7d3fa-e141-4966-b517-eeed275fd14c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:34.910211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ac7d3fa-e141-4966-b517-eeed275fd14c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:34.910664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ac7d3fa-e141-4966-b517-eeed275fd14c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:34.911089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ac7d3fa-e141-4966-b517-eeed275fd14c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:34.939505 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2ac7d3fa-e141-4966-b517-eeed275fd14c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043396 Aug 22 19:27:34.940073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 479/966] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:35.315836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:35.316451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:35.322748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:35.323233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:35.323692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:35.324388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:35.324843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:35.325269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:35.388397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:35.396627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d1fcb2d-a4c3-4672-8026-f6339aa97439 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084630 Aug 22 19:27:35.397187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 480/967] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:35 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:27:35.951674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a01474dc-7ace-4783-8235-1c0ddccc480c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:35.953852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a01474dc-7ace-4783-8235-1c0ddccc480c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:35.959899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01474dc-7ace-4783-8235-1c0ddccc480c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:35.960383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01474dc-7ace-4783-8235-1c0ddccc480c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:35.960824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01474dc-7ace-4783-8235-1c0ddccc480c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:35.961511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01474dc-7ace-4783-8235-1c0ddccc480c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:35.961964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01474dc-7ace-4783-8235-1c0ddccc480c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:35.962388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a01474dc-7ace-4783-8235-1c0ddccc480c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:35.991693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a01474dc-7ace-4783-8235-1c0ddccc480c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Aug 22 19:27:35.992239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 481/968] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:36.417068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:36.417738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:36.424061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:36.424546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:36.424984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:36.425678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:36.426136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:36.426562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:36.488271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:36.495920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f67a3cde-3b3e-483c-8d56-234aa47c965e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082747 Aug 22 19:27:36.496481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 482/969] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:36 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:27:37.003942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b8d9c783-88e6-4d46-b737-e8bc13c4eaf2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:37.006063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b8d9c783-88e6-4d46-b737-e8bc13c4eaf2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:37.012481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8d9c783-88e6-4d46-b737-e8bc13c4eaf2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:37.012958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8d9c783-88e6-4d46-b737-e8bc13c4eaf2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:37.013391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8d9c783-88e6-4d46-b737-e8bc13c4eaf2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:37.014071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8d9c783-88e6-4d46-b737-e8bc13c4eaf2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:37.014515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8d9c783-88e6-4d46-b737-e8bc13c4eaf2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:37.014930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8d9c783-88e6-4d46-b737-e8bc13c4eaf2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:37.043680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b8d9c783-88e6-4d46-b737-e8bc13c4eaf2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Aug 22 19:27:37.044217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 483/970] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:37.515991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:37.517267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:37.523333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:37.523844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:37.524278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:37.524955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:37.525402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:37.525818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:37.585486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:37.593067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7ef17a4-fc9b-4108-823d-b6ba66113c74 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.080950 Aug 22 19:27:37.593617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 484/971] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:37 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:27:38.056340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa3fe14b-34f8-48b4-99be-b0d7993c760c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:38.058466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa3fe14b-34f8-48b4-99be-b0d7993c760c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:38.064851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa3fe14b-34f8-48b4-99be-b0d7993c760c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:38.065324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa3fe14b-34f8-48b4-99be-b0d7993c760c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:38.065756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa3fe14b-34f8-48b4-99be-b0d7993c760c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:38.066466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa3fe14b-34f8-48b4-99be-b0d7993c760c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:38.066913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa3fe14b-34f8-48b4-99be-b0d7993c760c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:38.067328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa3fe14b-34f8-48b4-99be-b0d7993c760c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:38.095554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa3fe14b-34f8-48b4-99be-b0d7993c760c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Aug 22 19:27:38.096147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 485/972] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:38.614043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:38.614835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:38.621628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:38.622116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:38.622586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:38.623281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:38.623777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:38.624205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:38.685261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:38.692907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b1d6040-1937-4977-8752-83f46bb02b54 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083363 Aug 22 19:27:38.693492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 486/973] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:38 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:27:39.108333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cbdd1202-9652-4330-8228-e8bed78463f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:39.110563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cbdd1202-9652-4330-8228-e8bed78463f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:39.117301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdd1202-9652-4330-8228-e8bed78463f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:39.117787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdd1202-9652-4330-8228-e8bed78463f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:39.118224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdd1202-9652-4330-8228-e8bed78463f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:39.118951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdd1202-9652-4330-8228-e8bed78463f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:39.119437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdd1202-9652-4330-8228-e8bed78463f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:39.119893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbdd1202-9652-4330-8228-e8bed78463f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:39.148754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cbdd1202-9652-4330-8228-e8bed78463f7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Aug 22 19:27:39.149924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 487/974] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:39.712698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:39.713332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:39.719854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:39.720342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:39.720781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:39.721763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:39.722224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:39.722653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:39.786845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:27:39.794394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3818cc24-c9d9-4784-b265-d631a4c50657 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.085516 Aug 22 19:27:39.794945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 488/975] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:27:39 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:27:40.161980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-935a5e32-3760-408f-b2f2-6245f3117c50 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:40.164195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-935a5e32-3760-408f-b2f2-6245f3117c50 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:40.170041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-935a5e32-3760-408f-b2f2-6245f3117c50 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:40.170517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-935a5e32-3760-408f-b2f2-6245f3117c50 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:40.170944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-935a5e32-3760-408f-b2f2-6245f3117c50 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:40.171624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-935a5e32-3760-408f-b2f2-6245f3117c50 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:40.172095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-935a5e32-3760-408f-b2f2-6245f3117c50 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:40.173195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-935a5e32-3760-408f-b2f2-6245f3117c50 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:40.177084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:40.201678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-935a5e32-3760-408f-b2f2-6245f3117c50 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043578 Aug 22 19:27:40.202208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 489/976] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:27:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:27:40.556019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=37 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:40.579467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=78 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:40.733594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lazy-loading 'services' on Instance uuid 9698a0b1-a98a-40e1-9093-39946273a155 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:27:40.783970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:27:40.784471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:27:40.792215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:40.792697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:40.793129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:40.793824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:27:40.794275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:27:40.794701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:27:50.738094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:50.790013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=79 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:27:50.853664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:28:13.567919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bcacbcbd-b94d-4310-a272-4355118b6a93 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments/c73d1d5d-05f9-45c4-88b0-334566c488e3" status: 202 len: 0 microversion: 2.1 time: 43.020505 Aug 22 19:28:13.568858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 488/977] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:27:30 2022] DELETE /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments/c73d1d5d-05f9-45c4-88b0-334566c488e3 => generated 0 bytes in 43022 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:28:13.575081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:13.575806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:13.582928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:13.583769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:13.584257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:13.585061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:13.585897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:13.586327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:13.612956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'services' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:28:13.662552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:13.670119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a1f1b3ea-d451-4ef1-9b5d-c9785f755adb tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.100172 Aug 22 19:28:13.683601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 489/978] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:13 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:28:13.688589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6d4f2359-e950-4764-9d3d-93ea31840ae2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:13.690728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6d4f2359-e950-4764-9d3d-93ea31840ae2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:13.696789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d4f2359-e950-4764-9d3d-93ea31840ae2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:13.697280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d4f2359-e950-4764-9d3d-93ea31840ae2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:13.697723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d4f2359-e950-4764-9d3d-93ea31840ae2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:13.698459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d4f2359-e950-4764-9d3d-93ea31840ae2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:13.698913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d4f2359-e950-4764-9d3d-93ea31840ae2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:13.699341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d4f2359-e950-4764-9d3d-93ea31840ae2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:13.729138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6d4f2359-e950-4764-9d3d-93ea31840ae2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Aug 22 19:28:13.729699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 490/979] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:13.734289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bb4882f8-94ca-4f6f-815b-53235c885aa2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:13.736419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bb4882f8-94ca-4f6f-815b-53235c885aa2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:13.742023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb4882f8-94ca-4f6f-815b-53235c885aa2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:13.742503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb4882f8-94ca-4f6f-815b-53235c885aa2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:13.742942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb4882f8-94ca-4f6f-815b-53235c885aa2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:13.743693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb4882f8-94ca-4f6f-815b-53235c885aa2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:13.744152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb4882f8-94ca-4f6f-815b-53235c885aa2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:13.744582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb4882f8-94ca-4f6f-815b-53235c885aa2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:13.773585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bb4882f8-94ca-4f6f-815b-53235c885aa2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042824 Aug 22 19:28:13.774141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 491/980] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:14.690033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:14.690816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:14.697038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:14.697522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:14.697958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:14.698650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:14.699100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:14.699521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:14.760930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:14.768535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-65fc9121-2a90-4460-9e7e-a1f635da92b5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082392 Aug 22 19:28:14.769098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 492/981] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:14 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:14.774101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2fb89336-2bc4-4cc3-8ac6-f625900bc460 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:14.776253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2fb89336-2bc4-4cc3-8ac6-f625900bc460 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:14.781742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fb89336-2bc4-4cc3-8ac6-f625900bc460 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:14.782214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fb89336-2bc4-4cc3-8ac6-f625900bc460 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:14.782646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fb89336-2bc4-4cc3-8ac6-f625900bc460 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:14.783341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fb89336-2bc4-4cc3-8ac6-f625900bc460 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:14.783832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fb89336-2bc4-4cc3-8ac6-f625900bc460 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:14.784255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fb89336-2bc4-4cc3-8ac6-f625900bc460 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:14.812561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2fb89336-2bc4-4cc3-8ac6-f625900bc460 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042438 Aug 22 19:28:14.813103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 493/982] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:14.817997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-356b6887-55f8-43b9-8c5e-dd38bb4b3870 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:14.820115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-356b6887-55f8-43b9-8c5e-dd38bb4b3870 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:14.825543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-356b6887-55f8-43b9-8c5e-dd38bb4b3870 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:14.826016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-356b6887-55f8-43b9-8c5e-dd38bb4b3870 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:14.826451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-356b6887-55f8-43b9-8c5e-dd38bb4b3870 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:14.827134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-356b6887-55f8-43b9-8c5e-dd38bb4b3870 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:14.827582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-356b6887-55f8-43b9-8c5e-dd38bb4b3870 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:14.828029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-356b6887-55f8-43b9-8c5e-dd38bb4b3870 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:14.856089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-356b6887-55f8-43b9-8c5e-dd38bb4b3870 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041995 Aug 22 19:28:14.856627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 494/983] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:15.789379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:15.790108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:15.796377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:15.796854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:15.797288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:15.797977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:15.798429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:15.798851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:15.863179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:15.871373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9bec2975-09a5-474d-8ce5-3b728e39fbd7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.085852 Aug 22 19:28:15.871976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 495/984] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:15 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:15.876406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f4e2eca6-dac9-41a6-a859-2b4f3938bd1e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:15.878512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f4e2eca6-dac9-41a6-a859-2b4f3938bd1e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:15.884600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4e2eca6-dac9-41a6-a859-2b4f3938bd1e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:15.885076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4e2eca6-dac9-41a6-a859-2b4f3938bd1e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:15.885509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4e2eca6-dac9-41a6-a859-2b4f3938bd1e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:15.886231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4e2eca6-dac9-41a6-a859-2b4f3938bd1e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:15.886683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4e2eca6-dac9-41a6-a859-2b4f3938bd1e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:15.887155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4e2eca6-dac9-41a6-a859-2b4f3938bd1e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:15.916121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f4e2eca6-dac9-41a6-a859-2b4f3938bd1e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Aug 22 19:28:15.916660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 496/985] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:15.921125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-65d5fff3-9dcd-4b08-bb32-27551c4cd251 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:15.923171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-65d5fff3-9dcd-4b08-bb32-27551c4cd251 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:15.929046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d5fff3-9dcd-4b08-bb32-27551c4cd251 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:15.929514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d5fff3-9dcd-4b08-bb32-27551c4cd251 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:15.929942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d5fff3-9dcd-4b08-bb32-27551c4cd251 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:15.930616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d5fff3-9dcd-4b08-bb32-27551c4cd251 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:15.931059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d5fff3-9dcd-4b08-bb32-27551c4cd251 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:15.931475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65d5fff3-9dcd-4b08-bb32-27551c4cd251 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:15.959040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-65d5fff3-9dcd-4b08-bb32-27551c4cd251 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041435 Aug 22 19:28:15.959581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 497/986] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:15 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:16.892481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:16.893277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:16.900284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:16.900765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:16.901198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:16.901885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:16.902337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:16.902758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:16.964924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:16.972938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e99a1019-5b60-4f77-b5d3-ee82788d8684 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084310 Aug 22 19:28:16.973499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 498/987] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:16 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:16.977998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-495ce330-31af-4b38-82eb-db1f3003317c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:16.980182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-495ce330-31af-4b38-82eb-db1f3003317c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:16.986285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-495ce330-31af-4b38-82eb-db1f3003317c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:16.986941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-495ce330-31af-4b38-82eb-db1f3003317c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:16.987378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-495ce330-31af-4b38-82eb-db1f3003317c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:16.988124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-495ce330-31af-4b38-82eb-db1f3003317c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:16.988582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-495ce330-31af-4b38-82eb-db1f3003317c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:16.989009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-495ce330-31af-4b38-82eb-db1f3003317c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:17.017654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-495ce330-31af-4b38-82eb-db1f3003317c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043193 Aug 22 19:28:17.018205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 499/988] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:17.023207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ea12e15a-2abd-45d1-84d8-9cca8d25b4a7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:17.025319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ea12e15a-2abd-45d1-84d8-9cca8d25b4a7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:17.030657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea12e15a-2abd-45d1-84d8-9cca8d25b4a7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:17.031134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea12e15a-2abd-45d1-84d8-9cca8d25b4a7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:17.031564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea12e15a-2abd-45d1-84d8-9cca8d25b4a7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:17.032274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea12e15a-2abd-45d1-84d8-9cca8d25b4a7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:17.032727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea12e15a-2abd-45d1-84d8-9cca8d25b4a7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:17.033151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea12e15a-2abd-45d1-84d8-9cca8d25b4a7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:17.061022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ea12e15a-2abd-45d1-84d8-9cca8d25b4a7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 Aug 22 19:28:17.061570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 500/989] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:17.993493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:17.994197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:18.000485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:18.000967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:18.001400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:18.002093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:18.002544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:18.002967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:18.062763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:18.071005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-479aecfc-2ca5-4ec0-af47-6f98e3362e12 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.081906 Aug 22 19:28:18.071566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 501/990] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:17 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:18.076011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e55bb34a-25bb-4440-b3b2-194e45c54a22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:18.078246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e55bb34a-25bb-4440-b3b2-194e45c54a22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:18.084313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e55bb34a-25bb-4440-b3b2-194e45c54a22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:18.084789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e55bb34a-25bb-4440-b3b2-194e45c54a22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:18.085227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e55bb34a-25bb-4440-b3b2-194e45c54a22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:18.085914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e55bb34a-25bb-4440-b3b2-194e45c54a22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:18.086398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e55bb34a-25bb-4440-b3b2-194e45c54a22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:18.086824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e55bb34a-25bb-4440-b3b2-194e45c54a22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:18.115495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e55bb34a-25bb-4440-b3b2-194e45c54a22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Aug 22 19:28:18.116084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 502/991] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:18.120547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4ad3507e-5fbd-454f-ad56-8b1551576d81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:18.122635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4ad3507e-5fbd-454f-ad56-8b1551576d81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:18.128127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ad3507e-5fbd-454f-ad56-8b1551576d81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:18.128606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ad3507e-5fbd-454f-ad56-8b1551576d81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:18.129037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ad3507e-5fbd-454f-ad56-8b1551576d81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:18.129721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ad3507e-5fbd-454f-ad56-8b1551576d81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:18.130171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ad3507e-5fbd-454f-ad56-8b1551576d81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:18.130594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ad3507e-5fbd-454f-ad56-8b1551576d81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:18.158727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4ad3507e-5fbd-454f-ad56-8b1551576d81 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041642 Aug 22 19:28:18.159263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 503/992] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:18 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:19.092075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:19.092893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:19.100216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:19.100705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:19.101145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:19.101845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:19.102306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:19.102735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:19.165569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:19.173714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c5d99135-fa5d-4077-abf9-8c2630ac9867 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.085668 Aug 22 19:28:19.174276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 504/993] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:19 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:19.179331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-64877ee6-1f16-4bbf-be75-69f8072f2f28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:19.181462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-64877ee6-1f16-4bbf-be75-69f8072f2f28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:19.186942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64877ee6-1f16-4bbf-be75-69f8072f2f28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:19.187415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64877ee6-1f16-4bbf-be75-69f8072f2f28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:19.187882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64877ee6-1f16-4bbf-be75-69f8072f2f28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:19.188562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64877ee6-1f16-4bbf-be75-69f8072f2f28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:19.189006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64877ee6-1f16-4bbf-be75-69f8072f2f28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:19.189424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64877ee6-1f16-4bbf-be75-69f8072f2f28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:19.193347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:28:19.219329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-64877ee6-1f16-4bbf-be75-69f8072f2f28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 Aug 22 19:28:19.219893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 505/994] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:19 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:19.224969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a5c56b34-4f41-44ec-b823-cfa4274da6ae tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:19.227028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a5c56b34-4f41-44ec-b823-cfa4274da6ae tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:19.232694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5c56b34-4f41-44ec-b823-cfa4274da6ae tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:19.233164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5c56b34-4f41-44ec-b823-cfa4274da6ae tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:19.233591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5c56b34-4f41-44ec-b823-cfa4274da6ae tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:19.234265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5c56b34-4f41-44ec-b823-cfa4274da6ae tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:19.234708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5c56b34-4f41-44ec-b823-cfa4274da6ae tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:19.235123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5c56b34-4f41-44ec-b823-cfa4274da6ae tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:19.264388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a5c56b34-4f41-44ec-b823-cfa4274da6ae tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 Aug 22 19:28:19.264941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 506/995] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:19 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:20.195048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:20.195676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:20.202007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:20.202482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:20.202910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:20.203586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:20.204054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:20.204470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:20.266957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:20.274714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-75d031c0-c197-4a4c-8f4b-f95a1b4c511c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084130 Aug 22 19:28:20.275332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 507/996] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:20 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:20.279915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1671d230-c7b2-4e82-9677-3d1771d49059 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:20.282017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1671d230-c7b2-4e82-9677-3d1771d49059 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:20.287520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1671d230-c7b2-4e82-9677-3d1771d49059 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:20.288022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1671d230-c7b2-4e82-9677-3d1771d49059 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:20.288448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1671d230-c7b2-4e82-9677-3d1771d49059 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:20.289126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1671d230-c7b2-4e82-9677-3d1771d49059 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:20.289570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1671d230-c7b2-4e82-9677-3d1771d49059 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:20.289984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1671d230-c7b2-4e82-9677-3d1771d49059 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:20.318686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1671d230-c7b2-4e82-9677-3d1771d49059 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 Aug 22 19:28:20.319159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 508/997] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:20 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:20.323690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-76ff44c9-318f-446b-ae17-81e4f9d5cb04 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:20.325711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-76ff44c9-318f-446b-ae17-81e4f9d5cb04 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:20.331199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76ff44c9-318f-446b-ae17-81e4f9d5cb04 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:20.331702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76ff44c9-318f-446b-ae17-81e4f9d5cb04 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:20.332134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76ff44c9-318f-446b-ae17-81e4f9d5cb04 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:20.332812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76ff44c9-318f-446b-ae17-81e4f9d5cb04 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:20.333267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76ff44c9-318f-446b-ae17-81e4f9d5cb04 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:20.333715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76ff44c9-318f-446b-ae17-81e4f9d5cb04 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:20.361185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-76ff44c9-318f-446b-ae17-81e4f9d5cb04 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041089 Aug 22 19:28:20.361737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 509/998] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:20 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:21.294561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:21.295251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:21.301801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:21.302290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:21.302721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:21.303423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:21.303897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:21.304319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:21.368776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:21.376813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e47e9b8e-3ba1-4859-b205-92ac9775d652 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.086124 Aug 22 19:28:21.377389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 510/999] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:21 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:21.382685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e89c9a63-4bd3-4d7c-9355-bc71206138a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:21.384886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e89c9a63-4bd3-4d7c-9355-bc71206138a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:21.391094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e89c9a63-4bd3-4d7c-9355-bc71206138a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:21.391593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e89c9a63-4bd3-4d7c-9355-bc71206138a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:21.392048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e89c9a63-4bd3-4d7c-9355-bc71206138a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:21.392747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e89c9a63-4bd3-4d7c-9355-bc71206138a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:21.393192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e89c9a63-4bd3-4d7c-9355-bc71206138a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:21.393612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e89c9a63-4bd3-4d7c-9355-bc71206138a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:21.424578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e89c9a63-4bd3-4d7c-9355-bc71206138a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Aug 22 19:28:21.425071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 511/1000] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:21.429707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9969bab5-331b-4180-a40f-6d0dad2aae2b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:21.431901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9969bab5-331b-4180-a40f-6d0dad2aae2b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:21.438860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9969bab5-331b-4180-a40f-6d0dad2aae2b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:21.439347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9969bab5-331b-4180-a40f-6d0dad2aae2b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:21.439816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9969bab5-331b-4180-a40f-6d0dad2aae2b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:21.440532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9969bab5-331b-4180-a40f-6d0dad2aae2b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:21.440979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9969bab5-331b-4180-a40f-6d0dad2aae2b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:21.441396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9969bab5-331b-4180-a40f-6d0dad2aae2b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:21.478834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9969bab5-331b-4180-a40f-6d0dad2aae2b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052484 Aug 22 19:28:21.479666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 512/1001] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:21 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:22.398779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:22.399455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:22.405709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:22.406187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:22.406618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:22.407304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:22.407792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:22.408219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:22.470879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:22.479488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-005b1ff4-2493-433a-8e05-e64a8cdb5ba7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.085138 Aug 22 19:28:22.480115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 513/1002] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:22 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:22.484602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fa90e5c7-349e-4aab-b0e9-5155f6964ecc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:22.486781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fa90e5c7-349e-4aab-b0e9-5155f6964ecc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:22.492832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa90e5c7-349e-4aab-b0e9-5155f6964ecc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:22.493323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa90e5c7-349e-4aab-b0e9-5155f6964ecc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:22.493762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa90e5c7-349e-4aab-b0e9-5155f6964ecc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:22.494756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa90e5c7-349e-4aab-b0e9-5155f6964ecc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:22.495220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa90e5c7-349e-4aab-b0e9-5155f6964ecc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:22.495661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa90e5c7-349e-4aab-b0e9-5155f6964ecc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:22.524881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fa90e5c7-349e-4aab-b0e9-5155f6964ecc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Aug 22 19:28:22.525442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 514/1003] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:22.529867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-abc1411c-a38f-4bea-ad7f-65ed66838a50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:22.532009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-abc1411c-a38f-4bea-ad7f-65ed66838a50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:22.538186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abc1411c-a38f-4bea-ad7f-65ed66838a50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:22.538663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abc1411c-a38f-4bea-ad7f-65ed66838a50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:22.539100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abc1411c-a38f-4bea-ad7f-65ed66838a50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:22.539840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abc1411c-a38f-4bea-ad7f-65ed66838a50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:22.540294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abc1411c-a38f-4bea-ad7f-65ed66838a50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:22.540721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abc1411c-a38f-4bea-ad7f-65ed66838a50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:22.568177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-abc1411c-a38f-4bea-ad7f-65ed66838a50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041758 Aug 22 19:28:22.568728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 515/1004] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:22 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:23.499666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:23.500314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:23.507433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:23.508196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:23.508638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:23.509333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:23.509790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:23.510220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:23.571817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:23.579846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cf847cec-e597-4437-a694-1249a04e1752 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084056 Aug 22 19:28:23.580423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 516/1005] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:23 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:23.585568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f1ab328c-5b17-4eeb-b6b6-b652a71cc4ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:23.587720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f1ab328c-5b17-4eeb-b6b6-b652a71cc4ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:23.593591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1ab328c-5b17-4eeb-b6b6-b652a71cc4ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:23.594075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1ab328c-5b17-4eeb-b6b6-b652a71cc4ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:23.594539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1ab328c-5b17-4eeb-b6b6-b652a71cc4ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:23.595236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1ab328c-5b17-4eeb-b6b6-b652a71cc4ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:23.595719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1ab328c-5b17-4eeb-b6b6-b652a71cc4ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:23.596449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1ab328c-5b17-4eeb-b6b6-b652a71cc4ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:23.626018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f1ab328c-5b17-4eeb-b6b6-b652a71cc4ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Aug 22 19:28:23.626569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 517/1006] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:23.631604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-31d18a55-5c27-41d7-9094-f388d7ad4756 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:23.633709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-31d18a55-5c27-41d7-9094-f388d7ad4756 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:23.639162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31d18a55-5c27-41d7-9094-f388d7ad4756 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:23.639637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31d18a55-5c27-41d7-9094-f388d7ad4756 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:23.640096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31d18a55-5c27-41d7-9094-f388d7ad4756 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:23.640777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31d18a55-5c27-41d7-9094-f388d7ad4756 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:23.641225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31d18a55-5c27-41d7-9094-f388d7ad4756 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:23.641646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31d18a55-5c27-41d7-9094-f388d7ad4756 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:23.671437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-31d18a55-5c27-41d7-9094-f388d7ad4756 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Aug 22 19:28:23.671958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 518/1007] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:23 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:23.678082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:28:24.601961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:24.602558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:24.608958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:24.609454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:24.609881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:24.610563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:24.611009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:24.611425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:24.682068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:24.689966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0d1da140-3435-4ced-b00b-afc4045f5afd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.092477 Aug 22 19:28:24.690539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 519/1008] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:24 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:24.759475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-01fcee63-cace-47c2-8deb-506e89ae8bba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:24.761986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-01fcee63-cace-47c2-8deb-506e89ae8bba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:24.768134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fcee63-cace-47c2-8deb-506e89ae8bba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:24.768630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fcee63-cace-47c2-8deb-506e89ae8bba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:24.769063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fcee63-cace-47c2-8deb-506e89ae8bba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:24.769781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fcee63-cace-47c2-8deb-506e89ae8bba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:24.770280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fcee63-cace-47c2-8deb-506e89ae8bba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:24.770668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fcee63-cace-47c2-8deb-506e89ae8bba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:24.800171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-01fcee63-cace-47c2-8deb-506e89ae8bba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108639 Aug 22 19:28:24.800724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 520/1009] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:24.805344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-81f79e49-9e2d-4ddc-b0ee-958a6768f4e6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:24.807451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-81f79e49-9e2d-4ddc-b0ee-958a6768f4e6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:24.813038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81f79e49-9e2d-4ddc-b0ee-958a6768f4e6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:24.813512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81f79e49-9e2d-4ddc-b0ee-958a6768f4e6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:24.813967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81f79e49-9e2d-4ddc-b0ee-958a6768f4e6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:24.814650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81f79e49-9e2d-4ddc-b0ee-958a6768f4e6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:24.815103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81f79e49-9e2d-4ddc-b0ee-958a6768f4e6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:24.815527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81f79e49-9e2d-4ddc-b0ee-958a6768f4e6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:24.840009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:28:24.845178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-81f79e49-9e2d-4ddc-b0ee-958a6768f4e6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Aug 22 19:28:24.845737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 521/1010] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:24 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:24.900032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:28:24.900549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:28:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:28:25.712410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:25.713030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:25.719711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:25.720252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:25.720732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:25.721721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:25.722176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:25.722602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:25.787552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:25.795453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a52c02ce-24cc-48aa-b70c-05bbae5b58cd tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.087854 Aug 22 19:28:25.796040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 522/1011] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:25 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:25.811940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-45feea1c-9566-4175-bbc2-57af279afdfa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:25.814085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-45feea1c-9566-4175-bbc2-57af279afdfa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:25.820490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45feea1c-9566-4175-bbc2-57af279afdfa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:25.820996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45feea1c-9566-4175-bbc2-57af279afdfa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:25.821432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45feea1c-9566-4175-bbc2-57af279afdfa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:25.822131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45feea1c-9566-4175-bbc2-57af279afdfa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:25.822585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45feea1c-9566-4175-bbc2-57af279afdfa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:25.823005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45feea1c-9566-4175-bbc2-57af279afdfa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:25.853148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-45feea1c-9566-4175-bbc2-57af279afdfa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Aug 22 19:28:25.853719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 523/1012] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:25 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:28:25.858323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-02032de2-f5da-43c7-a800-00faf82ba9fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:25.860591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-02032de2-f5da-43c7-a800-00faf82ba9fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:25.866793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02032de2-f5da-43c7-a800-00faf82ba9fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:25.867277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02032de2-f5da-43c7-a800-00faf82ba9fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:25.867743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02032de2-f5da-43c7-a800-00faf82ba9fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:25.868453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02032de2-f5da-43c7-a800-00faf82ba9fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:25.868910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02032de2-f5da-43c7-a800-00faf82ba9fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:25.869382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02032de2-f5da-43c7-a800-00faf82ba9fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:25.899410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-02032de2-f5da-43c7-a800-00faf82ba9fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Aug 22 19:28:25.900012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 524/1013] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:25 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:26.816261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:26.816949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:26.823770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:26.824246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:26.824675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:26.825360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:26.825802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:26.826218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:26.889347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:26.896960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5b4d67f5-fdbf-4960-8303-03115eb2928a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084582 Aug 22 19:28:26.897516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 525/1014] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:26 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:26.901925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8aa5fdb4-c456-4065-a430-5f8b8d0215fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:26.904067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8aa5fdb4-c456-4065-a430-5f8b8d0215fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:26.909901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8aa5fdb4-c456-4065-a430-5f8b8d0215fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:26.910380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8aa5fdb4-c456-4065-a430-5f8b8d0215fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:26.910808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8aa5fdb4-c456-4065-a430-5f8b8d0215fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:26.911501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8aa5fdb4-c456-4065-a430-5f8b8d0215fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:26.911975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8aa5fdb4-c456-4065-a430-5f8b8d0215fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:26.912398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8aa5fdb4-c456-4065-a430-5f8b8d0215fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:26.941336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8aa5fdb4-c456-4065-a430-5f8b8d0215fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042853 Aug 22 19:28:26.941883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 526/1015] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:26 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:26.946800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b951c168-ced3-4573-ad74-007d5a40880b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:26.948893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b951c168-ced3-4573-ad74-007d5a40880b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:26.954256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b951c168-ced3-4573-ad74-007d5a40880b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:26.954732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b951c168-ced3-4573-ad74-007d5a40880b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:26.955158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b951c168-ced3-4573-ad74-007d5a40880b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:26.955865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b951c168-ced3-4573-ad74-007d5a40880b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:26.956313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b951c168-ced3-4573-ad74-007d5a40880b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:26.956733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b951c168-ced3-4573-ad74-007d5a40880b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:26.984861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b951c168-ced3-4573-ad74-007d5a40880b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041992 Aug 22 19:28:26.985545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 527/1016] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:26 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:27.919057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:27.919780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:27.926185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:27.926659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:27.927091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:27.927813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:27.928770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:27.929189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:27.989938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:27.998421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0c5b61cd-7fd6-42d8-a9f4-191e859ef984 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083391 Aug 22 19:28:27.998979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 528/1017] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:27 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:28.003506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dbfd8bc3-ac7b-4338-9a68-6c6168d634e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:28.005651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dbfd8bc3-ac7b-4338-9a68-6c6168d634e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:28.011269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd8bc3-ac7b-4338-9a68-6c6168d634e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:28.011769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd8bc3-ac7b-4338-9a68-6c6168d634e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:28.012220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd8bc3-ac7b-4338-9a68-6c6168d634e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:28.012903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd8bc3-ac7b-4338-9a68-6c6168d634e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:28.013350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd8bc3-ac7b-4338-9a68-6c6168d634e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:28.013770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dbfd8bc3-ac7b-4338-9a68-6c6168d634e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:28.042439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dbfd8bc3-ac7b-4338-9a68-6c6168d634e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042424 Aug 22 19:28:28.042991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 529/1018] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:28.047369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-716e4eeb-0d5c-4cc4-9217-e88a40f88d18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:28.049466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-716e4eeb-0d5c-4cc4-9217-e88a40f88d18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:28.055513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-716e4eeb-0d5c-4cc4-9217-e88a40f88d18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:28.056020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-716e4eeb-0d5c-4cc4-9217-e88a40f88d18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:28.056462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-716e4eeb-0d5c-4cc4-9217-e88a40f88d18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:28.057139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-716e4eeb-0d5c-4cc4-9217-e88a40f88d18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:28.057590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-716e4eeb-0d5c-4cc4-9217-e88a40f88d18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:28.058014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-716e4eeb-0d5c-4cc4-9217-e88a40f88d18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:28.085282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-716e4eeb-0d5c-4cc4-9217-e88a40f88d18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041348 Aug 22 19:28:28.085825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 530/1019] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:28 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:28.247691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:28:28.248103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:28:29.023398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:29.024357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:29.035204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:29.036037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:29.036749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:29.038404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:29.039150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:29.039890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:29.139231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:29.153284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-046569d3-22c3-4802-a0e0-dbc2367c3b2b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.136390 Aug 22 19:28:29.154265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 531/1020] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:29 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:29.162388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2975fbc1-8065-4da9-8727-2be9c72fc650 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:29.166411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2975fbc1-8065-4da9-8727-2be9c72fc650 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:29.176783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2975fbc1-8065-4da9-8727-2be9c72fc650 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:29.177565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2975fbc1-8065-4da9-8727-2be9c72fc650 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:29.178331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2975fbc1-8065-4da9-8727-2be9c72fc650 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:29.179467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2975fbc1-8065-4da9-8727-2be9c72fc650 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:29.180250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2975fbc1-8065-4da9-8727-2be9c72fc650 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:29.180947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2975fbc1-8065-4da9-8727-2be9c72fc650 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:29.233694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2975fbc1-8065-4da9-8727-2be9c72fc650 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077684 Aug 22 19:28:29.234702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 532/1021] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:29.242439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-14d186e2-f4bc-4627-85ed-a90e4da731f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:29.245906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-14d186e2-f4bc-4627-85ed-a90e4da731f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:29.255902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14d186e2-f4bc-4627-85ed-a90e4da731f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:29.256716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14d186e2-f4bc-4627-85ed-a90e4da731f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:29.257428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14d186e2-f4bc-4627-85ed-a90e4da731f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:29.258572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14d186e2-f4bc-4627-85ed-a90e4da731f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:29.259322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14d186e2-f4bc-4627-85ed-a90e4da731f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:29.260056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14d186e2-f4bc-4627-85ed-a90e4da731f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:29.313128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-14d186e2-f4bc-4627-85ed-a90e4da731f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077003 Aug 22 19:28:29.313739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 533/1022] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:29 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:30.187091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:30.187791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:30.194748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:30.195223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:30.195673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:30.196352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:30.196798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:30.197213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:30.258122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:30.265905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a45371e6-856f-4d73-8c10-91d4e982ec50 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082734 Aug 22 19:28:30.266462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 534/1023] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:30 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:30.271059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d413634f-0c31-4a7c-bab8-1b4ec9112e56 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:30.273223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d413634f-0c31-4a7c-bab8-1b4ec9112e56 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:30.279227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d413634f-0c31-4a7c-bab8-1b4ec9112e56 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:30.279743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d413634f-0c31-4a7c-bab8-1b4ec9112e56 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:30.280181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d413634f-0c31-4a7c-bab8-1b4ec9112e56 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:30.280871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d413634f-0c31-4a7c-bab8-1b4ec9112e56 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:30.281320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d413634f-0c31-4a7c-bab8-1b4ec9112e56 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:30.281744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d413634f-0c31-4a7c-bab8-1b4ec9112e56 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:30.310924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d413634f-0c31-4a7c-bab8-1b4ec9112e56 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043468 Aug 22 19:28:30.311474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 535/1024] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:30 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:30.325310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bed9bc81-a7e8-459a-8334-b400748f2533 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:30.327417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bed9bc81-a7e8-459a-8334-b400748f2533 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:30.333128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bed9bc81-a7e8-459a-8334-b400748f2533 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:30.333606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bed9bc81-a7e8-459a-8334-b400748f2533 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:30.334046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bed9bc81-a7e8-459a-8334-b400748f2533 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:30.334735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bed9bc81-a7e8-459a-8334-b400748f2533 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:30.335185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bed9bc81-a7e8-459a-8334-b400748f2533 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:30.335610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bed9bc81-a7e8-459a-8334-b400748f2533 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:30.364641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bed9bc81-a7e8-459a-8334-b400748f2533 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042866 Aug 22 19:28:30.365204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 536/1025] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:30 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:28:31.287317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:31.288753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:31.295393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:31.295914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:31.296350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:31.297054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:31.297503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:31.297930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:31.366908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:31.375412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c6281a93-c655-4060-b233-65dcfa3e30c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.092426 Aug 22 19:28:31.387673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 537/1026] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:31 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:31.387673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c8c14824-3017-4c5f-a200-1eec75827b6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:31.387673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c8c14824-3017-4c5f-a200-1eec75827b6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:31.387673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:28:31.390645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8c14824-3017-4c5f-a200-1eec75827b6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:31.391134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8c14824-3017-4c5f-a200-1eec75827b6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:31.391573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8c14824-3017-4c5f-a200-1eec75827b6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:31.392313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8c14824-3017-4c5f-a200-1eec75827b6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:31.392763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8c14824-3017-4c5f-a200-1eec75827b6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:31.393182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8c14824-3017-4c5f-a200-1eec75827b6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:31.411831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:28:31.427628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c8c14824-3017-4c5f-a200-1eec75827b6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050137 Aug 22 19:28:31.428755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 538/1027] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:31.433473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6c3a6ab3-1993-4f7d-b969-777d9c29a699 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:31.435629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6c3a6ab3-1993-4f7d-b969-777d9c29a699 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:31.441981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c3a6ab3-1993-4f7d-b969-777d9c29a699 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:31.442468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c3a6ab3-1993-4f7d-b969-777d9c29a699 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:31.442900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c3a6ab3-1993-4f7d-b969-777d9c29a699 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:31.443604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c3a6ab3-1993-4f7d-b969-777d9c29a699 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:31.444662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c3a6ab3-1993-4f7d-b969-777d9c29a699 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:31.445088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c3a6ab3-1993-4f7d-b969-777d9c29a699 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:31.476325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6c3a6ab3-1993-4f7d-b969-777d9c29a699 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046470 Aug 22 19:28:31.476930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 539/1028] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:31 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:32.396715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:32.397386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:32.403734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:32.404227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:32.404673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:32.405374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:32.405830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:32.406259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:32.468859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:32.477586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c104f5f6-1841-40f8-af02-2d0d15449cf7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084873 Aug 22 19:28:32.478149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 540/1029] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:32 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:32.482715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6e9d9d7b-8435-4554-b5f6-02a006c1b0dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:32.485067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6e9d9d7b-8435-4554-b5f6-02a006c1b0dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:32.491754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e9d9d7b-8435-4554-b5f6-02a006c1b0dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:32.492230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e9d9d7b-8435-4554-b5f6-02a006c1b0dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:32.492655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e9d9d7b-8435-4554-b5f6-02a006c1b0dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:32.493376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e9d9d7b-8435-4554-b5f6-02a006c1b0dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:32.493848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e9d9d7b-8435-4554-b5f6-02a006c1b0dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:32.494267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e9d9d7b-8435-4554-b5f6-02a006c1b0dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:32.524299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6e9d9d7b-8435-4554-b5f6-02a006c1b0dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 Aug 22 19:28:32.524868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 541/1030] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:32.529336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-db89c04b-45fc-4685-b224-5307bcd40f47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:32.531454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-db89c04b-45fc-4685-b224-5307bcd40f47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:32.537094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db89c04b-45fc-4685-b224-5307bcd40f47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:32.538124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db89c04b-45fc-4685-b224-5307bcd40f47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:32.538529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db89c04b-45fc-4685-b224-5307bcd40f47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:32.539213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db89c04b-45fc-4685-b224-5307bcd40f47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:32.539682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db89c04b-45fc-4685-b224-5307bcd40f47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:32.540102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db89c04b-45fc-4685-b224-5307bcd40f47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:32.568348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-db89c04b-45fc-4685-b224-5307bcd40f47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042481 Aug 22 19:28:32.568962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 542/1031] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:32 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:33.498151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:33.498915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:33.505939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:33.506938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:33.507367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:33.508091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:33.508540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:33.508957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:33.572366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:33.580381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-670b7261-f4f6-4217-9c88-3621670537ec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.085989 Aug 22 19:28:33.581255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 543/1032] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:33 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:33.586999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-edcd8762-58ca-4b60-b24e-1ff8610e879c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:33.592559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-edcd8762-58ca-4b60-b24e-1ff8610e879c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:33.598894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edcd8762-58ca-4b60-b24e-1ff8610e879c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:33.599372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edcd8762-58ca-4b60-b24e-1ff8610e879c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:33.599842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edcd8762-58ca-4b60-b24e-1ff8610e879c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:33.600533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edcd8762-58ca-4b60-b24e-1ff8610e879c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:33.600980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edcd8762-58ca-4b60-b24e-1ff8610e879c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:33.601398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edcd8762-58ca-4b60-b24e-1ff8610e879c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:33.630908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-edcd8762-58ca-4b60-b24e-1ff8610e879c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048412 Aug 22 19:28:33.632027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 544/1033] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:33 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:33.636460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2c91c22c-e1ab-462f-bee5-dcf7e5d2e4ad tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:33.638574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2c91c22c-e1ab-462f-bee5-dcf7e5d2e4ad tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:33.644482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c91c22c-e1ab-462f-bee5-dcf7e5d2e4ad tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:33.645039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c91c22c-e1ab-462f-bee5-dcf7e5d2e4ad tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:33.645473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c91c22c-e1ab-462f-bee5-dcf7e5d2e4ad tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:33.646158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c91c22c-e1ab-462f-bee5-dcf7e5d2e4ad tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:33.646603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c91c22c-e1ab-462f-bee5-dcf7e5d2e4ad tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:33.647050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c91c22c-e1ab-462f-bee5-dcf7e5d2e4ad tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:33.675826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2c91c22c-e1ab-462f-bee5-dcf7e5d2e4ad tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042737 Aug 22 19:28:33.676394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 545/1034] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:33 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:34.607096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:34.607826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:34.614151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:34.614653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:34.615072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:34.615830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:34.616287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:34.616713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:34.677831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:34.685595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f6ed059c-3aa3-499a-9452-f4e99bf10f2d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082360 Aug 22 19:28:34.686160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 546/1035] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:34 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:34.690781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-11680a33-687f-4e9b-97aa-d020202221e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:34.692934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-11680a33-687f-4e9b-97aa-d020202221e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:34.699133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11680a33-687f-4e9b-97aa-d020202221e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:34.699607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11680a33-687f-4e9b-97aa-d020202221e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:34.700078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11680a33-687f-4e9b-97aa-d020202221e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:34.700765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11680a33-687f-4e9b-97aa-d020202221e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:34.701217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11680a33-687f-4e9b-97aa-d020202221e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:34.701639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11680a33-687f-4e9b-97aa-d020202221e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:34.730723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-11680a33-687f-4e9b-97aa-d020202221e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Aug 22 19:28:34.731281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 547/1036] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:34.735886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-16f59a20-e323-4412-a0b9-ccfaf8b32da9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:34.737982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-16f59a20-e323-4412-a0b9-ccfaf8b32da9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:34.743587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16f59a20-e323-4412-a0b9-ccfaf8b32da9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:34.744100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16f59a20-e323-4412-a0b9-ccfaf8b32da9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:34.744535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16f59a20-e323-4412-a0b9-ccfaf8b32da9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:34.745230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16f59a20-e323-4412-a0b9-ccfaf8b32da9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:34.745675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16f59a20-e323-4412-a0b9-ccfaf8b32da9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:34.746098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16f59a20-e323-4412-a0b9-ccfaf8b32da9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:34.775507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-16f59a20-e323-4412-a0b9-ccfaf8b32da9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 Aug 22 19:28:34.776097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 548/1037] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:34 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:35.706044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:35.706741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:35.713683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:35.714157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:35.714587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:35.715273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:35.715749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:35.716166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:35.780051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:35.788496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d7410246-0771-4fb0-b4e4-d0190f4107c8 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.085734 Aug 22 19:28:35.789063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 549/1038] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:35 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:35.793652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f90a3dbe-a310-454f-ac3f-3972fa8d8d3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:35.795877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f90a3dbe-a310-454f-ac3f-3972fa8d8d3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:35.801604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f90a3dbe-a310-454f-ac3f-3972fa8d8d3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:35.802085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f90a3dbe-a310-454f-ac3f-3972fa8d8d3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:35.802518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f90a3dbe-a310-454f-ac3f-3972fa8d8d3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:35.803840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f90a3dbe-a310-454f-ac3f-3972fa8d8d3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:35.804299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f90a3dbe-a310-454f-ac3f-3972fa8d8d3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:35.804731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f90a3dbe-a310-454f-ac3f-3972fa8d8d3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:35.833974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f90a3dbe-a310-454f-ac3f-3972fa8d8d3b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043886 Aug 22 19:28:35.835133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 550/1039] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:35.839786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-90ada257-ad7c-410f-8b89-8f41c5c49ce3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:35.841907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-90ada257-ad7c-410f-8b89-8f41c5c49ce3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:35.847884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90ada257-ad7c-410f-8b89-8f41c5c49ce3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:35.848359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90ada257-ad7c-410f-8b89-8f41c5c49ce3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:35.848793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90ada257-ad7c-410f-8b89-8f41c5c49ce3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:35.849483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90ada257-ad7c-410f-8b89-8f41c5c49ce3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:35.849933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90ada257-ad7c-410f-8b89-8f41c5c49ce3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:35.850449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90ada257-ad7c-410f-8b89-8f41c5c49ce3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:35.879678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-90ada257-ad7c-410f-8b89-8f41c5c49ce3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043392 Aug 22 19:28:35.880233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 551/1040] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:35 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:36.809222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:36.809887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:36.816274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:36.816758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:36.817195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:36.817886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:36.818338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:36.818886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:36.879896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:36.888137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dd656cca-3f4f-4307-a8d2-2a1fcef713ed tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082754 Aug 22 19:28:36.888717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 552/1041] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:36 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:36.893273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-098c3f05-7895-4150-898a-71de4047f2fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:36.895408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-098c3f05-7895-4150-898a-71de4047f2fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:36.901123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-098c3f05-7895-4150-898a-71de4047f2fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:36.901601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-098c3f05-7895-4150-898a-71de4047f2fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:36.902035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-098c3f05-7895-4150-898a-71de4047f2fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:36.902730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-098c3f05-7895-4150-898a-71de4047f2fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:36.903179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-098c3f05-7895-4150-898a-71de4047f2fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:36.903601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-098c3f05-7895-4150-898a-71de4047f2fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:36.932605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-098c3f05-7895-4150-898a-71de4047f2fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042887 Aug 22 19:28:36.933159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 553/1042] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:36.937638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c8e896c2-d815-4582-b273-6256e5c751bb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:36.939829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c8e896c2-d815-4582-b273-6256e5c751bb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:36.945587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e896c2-d815-4582-b273-6256e5c751bb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:36.946063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e896c2-d815-4582-b273-6256e5c751bb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:36.947003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e896c2-d815-4582-b273-6256e5c751bb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:36.947733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e896c2-d815-4582-b273-6256e5c751bb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:36.948189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e896c2-d815-4582-b273-6256e5c751bb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:36.948615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e896c2-d815-4582-b273-6256e5c751bb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:36.977861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c8e896c2-d815-4582-b273-6256e5c751bb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Aug 22 19:28:36.978424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 554/1043] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:36 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:37.908216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:37.908910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:37.915800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:37.916284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:37.916721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:37.917414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:37.917867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:37.918294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:37.922340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:28:37.983044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:37.991605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-88ea1463-5d64-4213-8862-95dea002553d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.086655 Aug 22 19:28:37.992203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 555/1044] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:37 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:37.996743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-70d3e0ec-73cf-4d74-821f-23a3d1a16369 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:37.998898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-70d3e0ec-73cf-4d74-821f-23a3d1a16369 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:38.004813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70d3e0ec-73cf-4d74-821f-23a3d1a16369 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:38.005293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70d3e0ec-73cf-4d74-821f-23a3d1a16369 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:38.005723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70d3e0ec-73cf-4d74-821f-23a3d1a16369 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:38.006438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70d3e0ec-73cf-4d74-821f-23a3d1a16369 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:38.006889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70d3e0ec-73cf-4d74-821f-23a3d1a16369 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:38.007309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70d3e0ec-73cf-4d74-821f-23a3d1a16369 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:38.036169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-70d3e0ec-73cf-4d74-821f-23a3d1a16369 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042912 Aug 22 19:28:38.036738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 556/1045] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:37 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:38.041789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0a65ef85-2ef6-4b98-b3e0-49a7dfb795c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:38.043943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0a65ef85-2ef6-4b98-b3e0-49a7dfb795c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:38.049590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a65ef85-2ef6-4b98-b3e0-49a7dfb795c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:38.050065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a65ef85-2ef6-4b98-b3e0-49a7dfb795c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:38.050496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a65ef85-2ef6-4b98-b3e0-49a7dfb795c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:38.051175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a65ef85-2ef6-4b98-b3e0-49a7dfb795c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:38.051630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a65ef85-2ef6-4b98-b3e0-49a7dfb795c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:38.052074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a65ef85-2ef6-4b98-b3e0-49a7dfb795c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:38.080514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0a65ef85-2ef6-4b98-b3e0-49a7dfb795c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042781 Aug 22 19:28:38.081079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 557/1046] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:38 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:39.011045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:39.011734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:39.018223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:39.018705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:39.019145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:39.019868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:39.020318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:39.020736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:39.087021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:39.095049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9809a28e-ff52-467c-b346-ef74cf0a8a1a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.087947 Aug 22 19:28:39.095630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 558/1047] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:39 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:39.101035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fded781e-57ef-4275-b12a-42f7719c8265 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:39.103158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fded781e-57ef-4275-b12a-42f7719c8265 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:39.109166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fded781e-57ef-4275-b12a-42f7719c8265 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:39.109655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fded781e-57ef-4275-b12a-42f7719c8265 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:39.110092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fded781e-57ef-4275-b12a-42f7719c8265 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:39.110797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fded781e-57ef-4275-b12a-42f7719c8265 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:39.111248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fded781e-57ef-4275-b12a-42f7719c8265 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:39.111691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fded781e-57ef-4275-b12a-42f7719c8265 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:39.140958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fded781e-57ef-4275-b12a-42f7719c8265 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Aug 22 19:28:39.141664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 559/1048] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:39.147423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9f132525-0d9c-4f3d-ad08-0467df99143b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:39.149095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9f132525-0d9c-4f3d-ad08-0467df99143b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:39.155006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f132525-0d9c-4f3d-ad08-0467df99143b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:39.155485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f132525-0d9c-4f3d-ad08-0467df99143b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:39.155956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f132525-0d9c-4f3d-ad08-0467df99143b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:39.156652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f132525-0d9c-4f3d-ad08-0467df99143b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:39.157100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f132525-0d9c-4f3d-ad08-0467df99143b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:39.157523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f132525-0d9c-4f3d-ad08-0467df99143b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:39.187937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9f132525-0d9c-4f3d-ad08-0467df99143b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045144 Aug 22 19:28:39.188494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 560/1049] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:39 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:40.118089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:40.118791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:40.125301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:40.125785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:40.126221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:40.126917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:40.127363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:40.127822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:40.189210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:28:40.197063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-200f130c-01b8-4b93-9bae-899d8320274e tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083413 Aug 22 19:28:40.197642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 561/1050] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:28:40 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:28:40.202147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dd8601a3-c102-40b6-af00-ccbbd7757f45 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:40.204331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dd8601a3-c102-40b6-af00-ccbbd7757f45 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:40.210031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8601a3-c102-40b6-af00-ccbbd7757f45 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:40.210512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8601a3-c102-40b6-af00-ccbbd7757f45 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:40.210948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8601a3-c102-40b6-af00-ccbbd7757f45 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:40.211666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8601a3-c102-40b6-af00-ccbbd7757f45 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:40.212122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8601a3-c102-40b6-af00-ccbbd7757f45 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:40.212549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8601a3-c102-40b6-af00-ccbbd7757f45 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:40.242499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dd8601a3-c102-40b6-af00-ccbbd7757f45 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043846 Aug 22 19:28:40.243055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 562/1051] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:40.247510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f49ae46a-4995-40f0-8352-ca0215d010a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:40.249643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f49ae46a-4995-40f0-8352-ca0215d010a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:40.255297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f49ae46a-4995-40f0-8352-ca0215d010a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:40.255828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f49ae46a-4995-40f0-8352-ca0215d010a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:40.256302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f49ae46a-4995-40f0-8352-ca0215d010a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:40.256994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f49ae46a-4995-40f0-8352-ca0215d010a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:40.257442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f49ae46a-4995-40f0-8352-ca0215d010a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:40.257866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f49ae46a-4995-40f0-8352-ca0215d010a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:40.286758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f49ae46a-4995-40f0-8352-ca0215d010a2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042707 Aug 22 19:28:40.287310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 563/1052] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:28:40 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:28:40.843382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:28:40.843890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:28:40.850175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:40.850648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:40.851078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:40.851800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:28:40.852249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:28:40.852665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:28:50.847515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=52 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:28:50.870843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=56 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:29:40.955403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e96b481f-6120-4721-823e-c9687d9b6b07 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 202 len: 0 microversion: 2.1 time: 120.176026 Aug 22 19:29:40.956511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 490/1053] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:27:40 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 0 bytes in 120178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 19:29:40.969030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:29:40.969740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:29:40.978478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:29:40.978984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:29:40.979819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:29:40.980535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:29:40.980990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:29:40.981417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:29:41.047977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:29:41.055843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efcdfe69-fcf6-4a9a-80d8-27b0b65346a5 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.098189 Aug 22 19:29:41.056401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 491/1054] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:29:40 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:29:41.062064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3910b286-5201-4817-8c0f-9c5801eb2915 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:29:41.064382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3910b286-5201-4817-8c0f-9c5801eb2915 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:29:41.070943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3910b286-5201-4817-8c0f-9c5801eb2915 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:29:41.071444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3910b286-5201-4817-8c0f-9c5801eb2915 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:29:41.071917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3910b286-5201-4817-8c0f-9c5801eb2915 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:29:41.072628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3910b286-5201-4817-8c0f-9c5801eb2915 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:29:41.073085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3910b286-5201-4817-8c0f-9c5801eb2915 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:29:41.073511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3910b286-5201-4817-8c0f-9c5801eb2915 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:29:41.104804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3910b286-5201-4817-8c0f-9c5801eb2915 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 Aug 22 19:29:41.105411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 492/1055] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:29:41 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:29:41.111111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fce85ca6-ca4f-45e1-9408-6d3b2a07ee59 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:29:41.113282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fce85ca6-ca4f-45e1-9408-6d3b2a07ee59 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:29:41.119130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fce85ca6-ca4f-45e1-9408-6d3b2a07ee59 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:29:41.119596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fce85ca6-ca4f-45e1-9408-6d3b2a07ee59 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:29:41.120066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fce85ca6-ca4f-45e1-9408-6d3b2a07ee59 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:29:41.120762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fce85ca6-ca4f-45e1-9408-6d3b2a07ee59 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:29:41.121211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fce85ca6-ca4f-45e1-9408-6d3b2a07ee59 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:29:41.121628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fce85ca6-ca4f-45e1-9408-6d3b2a07ee59 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:29:41.131732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'services' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:29:41.153806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fce85ca6-ca4f-45e1-9408-6d3b2a07ee59 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047374 Aug 22 19:29:41.154685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 493/1056] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:29:41 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:29:41.159246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:29:41.159758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:29:41.165421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:29:41.165892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:29:41.166322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:29:41.167006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:29:41.167451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:29:41.167898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:29:51.136686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:29:51.163608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:29:51.190133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:30:07.213888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:30:07.214418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:30:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:30:13.785264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-492cc64f-28d6-4ba7-8cd2-6dbc613bc68a) Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 HTTP/1.1 Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:30:13.787605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:30:13.790374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-492cc64f-28d6-4ba7-8cd2-6dbc613bc68a) Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': 'f6744e43-5389-4422-9030-dfdf1b522dcc', 'id': 'eb79d8da-4f31-4277-89a4-336e11f55658'} Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:30:13.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-492cc64f-28d6-4ba7-8cd2-6dbc613bc68a) Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:30:13.793098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-492cc64f-28d6-4ba7-8cd2-6dbc613bc68a) Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:30:13.794533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-492cc64f-28d6-4ba7-8cd2-6dbc613bc68a) Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:30:13.795842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-492cc64f-28d6-4ba7-8cd2-6dbc613bc68a) Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-492cc64f-28d6-4ba7-8cd2-6dbc613bc68a) Aug 22 19:30:13.798077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:30:13.799546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-492cc64f-28d6-4ba7-8cd2-6dbc613bc68a) {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:30:13.799546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-432226b4-088d-47e2-8366-704718e2d4e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 400 len: 269 microversion: 2.1 time: 92.949730 Aug 22 19:30:13.799546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 564/1057] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:28:40 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 269 bytes in 92951 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 19:30:13.799546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:13.799994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:13.804386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:13.805018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:13.805451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:13.806150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:13.806595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:13.807016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:13.837556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'services' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:30:13.872392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:13.886423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6a9ae63d-5591-44bd-8b36-e9af480a49cf tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.095735 Aug 22 19:30:13.887260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 565/1058] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:13 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:30:13.894625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2b3e0680-018a-4c09-b6f3-2b5732fbd3da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:13.900221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2b3e0680-018a-4c09-b6f3-2b5732fbd3da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:13.903876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b3e0680-018a-4c09-b6f3-2b5732fbd3da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:13.904371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b3e0680-018a-4c09-b6f3-2b5732fbd3da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:13.904814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b3e0680-018a-4c09-b6f3-2b5732fbd3da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:13.906094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b3e0680-018a-4c09-b6f3-2b5732fbd3da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:13.906548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b3e0680-018a-4c09-b6f3-2b5732fbd3da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:13.906978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b3e0680-018a-4c09-b6f3-2b5732fbd3da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:13.939087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2b3e0680-018a-4c09-b6f3-2b5732fbd3da tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048256 Aug 22 19:30:13.939697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 566/1059] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:13.949488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4bd4cac6-6a17-42f8-9cea-00ff89e98128 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:13.949488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4bd4cac6-6a17-42f8-9cea-00ff89e98128 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:13.952611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bd4cac6-6a17-42f8-9cea-00ff89e98128 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:13.953097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bd4cac6-6a17-42f8-9cea-00ff89e98128 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:13.953537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bd4cac6-6a17-42f8-9cea-00ff89e98128 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:13.954273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bd4cac6-6a17-42f8-9cea-00ff89e98128 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:13.954731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bd4cac6-6a17-42f8-9cea-00ff89e98128 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:13.955161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bd4cac6-6a17-42f8-9cea-00ff89e98128 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:13.987669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4bd4cac6-6a17-42f8-9cea-00ff89e98128 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046814 Aug 22 19:30:13.988351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 567/1060] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:14.908108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:14.908810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:14.915161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:14.915655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:14.916100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:14.916792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:14.917239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:14.917661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:14.982065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:14.990108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f180eca6-b90c-4289-af90-314e41c125c3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.086416 Aug 22 19:30:14.990692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 568/1061] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:14 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:14.995292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c52d1eb7-ed7d-40e4-94ce-b2ab13fd3494 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:14.997654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c52d1eb7-ed7d-40e4-94ce-b2ab13fd3494 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:15.003601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52d1eb7-ed7d-40e4-94ce-b2ab13fd3494 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:15.004112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52d1eb7-ed7d-40e4-94ce-b2ab13fd3494 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:15.004546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52d1eb7-ed7d-40e4-94ce-b2ab13fd3494 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:15.005241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52d1eb7-ed7d-40e4-94ce-b2ab13fd3494 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:15.005694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52d1eb7-ed7d-40e4-94ce-b2ab13fd3494 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:15.006149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52d1eb7-ed7d-40e4-94ce-b2ab13fd3494 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:15.036149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c52d1eb7-ed7d-40e4-94ce-b2ab13fd3494 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Aug 22 19:30:15.036732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 569/1062] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:15.041277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4b30c239-65c2-4499-98c1-0ec729479016 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:15.043389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4b30c239-65c2-4499-98c1-0ec729479016 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:15.049071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b30c239-65c2-4499-98c1-0ec729479016 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:15.049547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b30c239-65c2-4499-98c1-0ec729479016 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:15.049979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b30c239-65c2-4499-98c1-0ec729479016 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:15.050667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b30c239-65c2-4499-98c1-0ec729479016 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:15.051117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b30c239-65c2-4499-98c1-0ec729479016 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:15.051539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b30c239-65c2-4499-98c1-0ec729479016 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:15.080510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4b30c239-65c2-4499-98c1-0ec729479016 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Aug 22 19:30:15.081072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 570/1063] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:15 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:16.010669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:16.011366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:16.020838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:16.021809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:16.022300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:16.022969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:16.023423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:16.023877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:16.088288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:16.096334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b83b7aa2-12f6-485b-b797-a26ea1f69031 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.089504 Aug 22 19:30:16.096939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 571/1064] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:16 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:16.101429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-60b25351-f541-467c-920d-60c45f5a4c6e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:16.103558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-60b25351-f541-467c-920d-60c45f5a4c6e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:16.109405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60b25351-f541-467c-920d-60c45f5a4c6e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:16.109886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60b25351-f541-467c-920d-60c45f5a4c6e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:16.110318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60b25351-f541-467c-920d-60c45f5a4c6e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:16.111019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60b25351-f541-467c-920d-60c45f5a4c6e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:16.111470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60b25351-f541-467c-920d-60c45f5a4c6e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:16.111934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60b25351-f541-467c-920d-60c45f5a4c6e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:16.144188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-60b25351-f541-467c-920d-60c45f5a4c6e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046184 Aug 22 19:30:16.144772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 572/1065] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:16.149425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b147e714-2f93-4306-9c64-3d7952e5f7d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:16.151556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b147e714-2f93-4306-9c64-3d7952e5f7d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:16.158408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b147e714-2f93-4306-9c64-3d7952e5f7d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:16.158408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b147e714-2f93-4306-9c64-3d7952e5f7d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:16.158763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b147e714-2f93-4306-9c64-3d7952e5f7d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:16.159311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b147e714-2f93-4306-9c64-3d7952e5f7d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:16.159792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b147e714-2f93-4306-9c64-3d7952e5f7d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:16.160219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b147e714-2f93-4306-9c64-3d7952e5f7d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:16.189941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b147e714-2f93-4306-9c64-3d7952e5f7d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Aug 22 19:30:16.190506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 573/1066] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:16 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:17.117003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:17.117853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:17.124966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:17.125449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:17.125880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:17.126576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:17.127025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:17.127445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:17.189900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:17.197730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5ecc28aa-b04d-4ce3-9fdb-b3be34806d16 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084788 Aug 22 19:30:17.207747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 574/1067] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:17 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:17.207747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a40ee829-3424-4786-ad20-87477c633d8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:17.207747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a40ee829-3424-4786-ad20-87477c633d8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:17.211080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a40ee829-3424-4786-ad20-87477c633d8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:17.211552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a40ee829-3424-4786-ad20-87477c633d8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:17.212022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a40ee829-3424-4786-ad20-87477c633d8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:17.212707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a40ee829-3424-4786-ad20-87477c633d8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:17.213154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a40ee829-3424-4786-ad20-87477c633d8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:17.213571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a40ee829-3424-4786-ad20-87477c633d8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:17.246597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a40ee829-3424-4786-ad20-87477c633d8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 Aug 22 19:30:17.247363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 575/1068] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:17.252553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4f4b9a84-c35c-4b14-8d0f-57afa6de1eef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:17.254657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4f4b9a84-c35c-4b14-8d0f-57afa6de1eef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:17.260300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f4b9a84-c35c-4b14-8d0f-57afa6de1eef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:17.260772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f4b9a84-c35c-4b14-8d0f-57afa6de1eef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:17.261203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f4b9a84-c35c-4b14-8d0f-57afa6de1eef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:17.261881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f4b9a84-c35c-4b14-8d0f-57afa6de1eef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:17.262329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f4b9a84-c35c-4b14-8d0f-57afa6de1eef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:17.262767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f4b9a84-c35c-4b14-8d0f-57afa6de1eef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:17.292841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4f4b9a84-c35c-4b14-8d0f-57afa6de1eef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Aug 22 19:30:17.293392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 576/1069] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:18.219072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:18.220028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:18.226429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:18.226910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:18.227346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:18.228060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:18.228515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:18.228983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:18.290407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:18.298074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b14017f4-cf65-44d8-bdf3-a3ac64bb38ab tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083664 Aug 22 19:30:18.298634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 577/1070] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:18 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:18.303068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ab89dd5a-4320-4826-9866-d0718112365f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:18.305234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ab89dd5a-4320-4826-9866-d0718112365f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:18.311465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab89dd5a-4320-4826-9866-d0718112365f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:18.312521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab89dd5a-4320-4826-9866-d0718112365f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:18.312954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab89dd5a-4320-4826-9866-d0718112365f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:18.313649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab89dd5a-4320-4826-9866-d0718112365f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:18.314099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab89dd5a-4320-4826-9866-d0718112365f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:18.314521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab89dd5a-4320-4826-9866-d0718112365f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:18.344151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ab89dd5a-4320-4826-9866-d0718112365f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Aug 22 19:30:18.344894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 578/1071] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:18.349211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1999d2b9-fc23-4ae4-9f2b-09bbb71ebc34 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:18.351318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1999d2b9-fc23-4ae4-9f2b-09bbb71ebc34 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:18.357845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1999d2b9-fc23-4ae4-9f2b-09bbb71ebc34 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:18.358331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1999d2b9-fc23-4ae4-9f2b-09bbb71ebc34 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:18.358800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1999d2b9-fc23-4ae4-9f2b-09bbb71ebc34 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:18.359499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1999d2b9-fc23-4ae4-9f2b-09bbb71ebc34 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:18.359975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1999d2b9-fc23-4ae4-9f2b-09bbb71ebc34 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:18.360402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1999d2b9-fc23-4ae4-9f2b-09bbb71ebc34 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:18.389326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1999d2b9-fc23-4ae4-9f2b-09bbb71ebc34 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Aug 22 19:30:18.390789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 579/1072] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:18 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:19.320761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:19.321454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:19.328482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:19.328957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:19.329389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:19.330071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:19.330518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:19.330937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:19.395440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:19.403328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8701e24e-82fc-4c50-ab78-2258be1eb36c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.086365 Aug 22 19:30:19.403850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 580/1073] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:19 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:19.408512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dc48e471-50c8-41c0-b797-eef1f27073de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:19.410624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dc48e471-50c8-41c0-b797-eef1f27073de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:19.416246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc48e471-50c8-41c0-b797-eef1f27073de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:19.416717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc48e471-50c8-41c0-b797-eef1f27073de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:19.417142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc48e471-50c8-41c0-b797-eef1f27073de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:19.417821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc48e471-50c8-41c0-b797-eef1f27073de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:19.418263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc48e471-50c8-41c0-b797-eef1f27073de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:19.418676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc48e471-50c8-41c0-b797-eef1f27073de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:19.435634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:30:19.449531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dc48e471-50c8-41c0-b797-eef1f27073de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044646 Aug 22 19:30:19.450078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 581/1074] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:19 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:19.454595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3093e343-ab40-43b3-b4a0-40d412d86f4d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:19.456778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3093e343-ab40-43b3-b4a0-40d412d86f4d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:19.462266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3093e343-ab40-43b3-b4a0-40d412d86f4d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:19.462742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3093e343-ab40-43b3-b4a0-40d412d86f4d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:19.463168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3093e343-ab40-43b3-b4a0-40d412d86f4d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:19.463876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3093e343-ab40-43b3-b4a0-40d412d86f4d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:19.464398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3093e343-ab40-43b3-b4a0-40d412d86f4d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:19.464753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3093e343-ab40-43b3-b4a0-40d412d86f4d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:19.493384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3093e343-ab40-43b3-b4a0-40d412d86f4d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042349 Aug 22 19:30:19.493929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 582/1075] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:19 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:20.423874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:20.424606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:20.430873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:20.431354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:20.431825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:20.432517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:20.432973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:20.433395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:20.494416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:20.502390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-602085ee-35ca-4b73-b23f-f1851d5d3df7 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082511 Aug 22 19:30:20.502964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 583/1076] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:20 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:20.507527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d2c0c50b-1488-4466-845c-81dbb6708181 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:20.509684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d2c0c50b-1488-4466-845c-81dbb6708181 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:20.516156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2c0c50b-1488-4466-845c-81dbb6708181 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:20.516636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2c0c50b-1488-4466-845c-81dbb6708181 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:20.517070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2c0c50b-1488-4466-845c-81dbb6708181 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:20.517760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2c0c50b-1488-4466-845c-81dbb6708181 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:20.518208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2c0c50b-1488-4466-845c-81dbb6708181 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:20.518629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2c0c50b-1488-4466-845c-81dbb6708181 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:20.547756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d2c0c50b-1488-4466-845c-81dbb6708181 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Aug 22 19:30:20.548311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 584/1077] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:20 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:20.552702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a19adae5-1152-4e6d-82fa-1e7aa4fa8369 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:20.554820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a19adae5-1152-4e6d-82fa-1e7aa4fa8369 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:20.560988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a19adae5-1152-4e6d-82fa-1e7aa4fa8369 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:20.561490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a19adae5-1152-4e6d-82fa-1e7aa4fa8369 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:20.562415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a19adae5-1152-4e6d-82fa-1e7aa4fa8369 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:20.564089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a19adae5-1152-4e6d-82fa-1e7aa4fa8369 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:20.564089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a19adae5-1152-4e6d-82fa-1e7aa4fa8369 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:20.564089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a19adae5-1152-4e6d-82fa-1e7aa4fa8369 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:20.593924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a19adae5-1152-4e6d-82fa-1e7aa4fa8369 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044425 Aug 22 19:30:20.594437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 585/1078] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:20 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:21.522350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:21.523045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:21.529486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:21.529970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:21.530409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:21.531105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:21.531564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:21.532088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:21.592679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:21.600704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-965b8606-3c37-44e3-bdbd-e7156077b4b0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082298 Aug 22 19:30:21.601270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 586/1079] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:21 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:30:21.605769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fdf0a2db-1f1d-439e-a88f-a2e81326b931 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:21.607935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fdf0a2db-1f1d-439e-a88f-a2e81326b931 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:21.614352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdf0a2db-1f1d-439e-a88f-a2e81326b931 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:21.614843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdf0a2db-1f1d-439e-a88f-a2e81326b931 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:21.615286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdf0a2db-1f1d-439e-a88f-a2e81326b931 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:21.616122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdf0a2db-1f1d-439e-a88f-a2e81326b931 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:21.616682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdf0a2db-1f1d-439e-a88f-a2e81326b931 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:21.617225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdf0a2db-1f1d-439e-a88f-a2e81326b931 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:21.649402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fdf0a2db-1f1d-439e-a88f-a2e81326b931 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047105 Aug 22 19:30:21.649969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 587/1080] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:21.654593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bee4f12c-d22c-4977-96db-4e4220793f58 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:21.656754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bee4f12c-d22c-4977-96db-4e4220793f58 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:21.662395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bee4f12c-d22c-4977-96db-4e4220793f58 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:21.662874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bee4f12c-d22c-4977-96db-4e4220793f58 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:21.663309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bee4f12c-d22c-4977-96db-4e4220793f58 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:21.664038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bee4f12c-d22c-4977-96db-4e4220793f58 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:21.664500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bee4f12c-d22c-4977-96db-4e4220793f58 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:21.664927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bee4f12c-d22c-4977-96db-4e4220793f58 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:21.694610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bee4f12c-d22c-4977-96db-4e4220793f58 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043549 Aug 22 19:30:21.695174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 588/1081] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:21 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:22.622279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:22.622989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:22.629527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:22.630011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:22.630451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:22.631147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:22.631596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:22.632048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:22.693584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:22.701342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ff26cc39-8da2-463b-b912-6910e086e121 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.082947 Aug 22 19:30:22.701901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 589/1082] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:22 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:22.706886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-53151557-e0b1-4371-8571-c6c118ede4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:22.709078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-53151557-e0b1-4371-8571-c6c118ede4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:22.714836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53151557-e0b1-4371-8571-c6c118ede4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:22.715319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53151557-e0b1-4371-8571-c6c118ede4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:22.715784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53151557-e0b1-4371-8571-c6c118ede4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:22.716486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53151557-e0b1-4371-8571-c6c118ede4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:22.716935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53151557-e0b1-4371-8571-c6c118ede4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:22.717362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53151557-e0b1-4371-8571-c6c118ede4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:22.746325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-53151557-e0b1-4371-8571-c6c118ede4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 Aug 22 19:30:22.746877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 590/1083] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:22.751349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5c00daa5-2ad6-4204-abe6-03902ae12d60 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:22.753491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5c00daa5-2ad6-4204-abe6-03902ae12d60 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:22.759057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c00daa5-2ad6-4204-abe6-03902ae12d60 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:22.759530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c00daa5-2ad6-4204-abe6-03902ae12d60 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:22.759996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c00daa5-2ad6-4204-abe6-03902ae12d60 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:22.760857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c00daa5-2ad6-4204-abe6-03902ae12d60 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:22.761134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c00daa5-2ad6-4204-abe6-03902ae12d60 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:22.761557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c00daa5-2ad6-4204-abe6-03902ae12d60 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:22.789858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5c00daa5-2ad6-4204-abe6-03902ae12d60 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042017 Aug 22 19:30:22.790399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 591/1084] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:22 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:23.722821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:23.723530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:23.730015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:23.730506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:23.730945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:23.731660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:23.732126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:23.732556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:23.799003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:23.809392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dc818749-d556-4745-9700-0bb6a08afed9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.090700 Aug 22 19:30:23.809968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 592/1085] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:23 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:23.814976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6977e9b9-e0ff-4602-9ed6-d55f4ff5b9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:23.817149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6977e9b9-e0ff-4602-9ed6-d55f4ff5b9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:23.823373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6977e9b9-e0ff-4602-9ed6-d55f4ff5b9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:23.823886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6977e9b9-e0ff-4602-9ed6-d55f4ff5b9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:23.824324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6977e9b9-e0ff-4602-9ed6-d55f4ff5b9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:23.825029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6977e9b9-e0ff-4602-9ed6-d55f4ff5b9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:23.825490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6977e9b9-e0ff-4602-9ed6-d55f4ff5b9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:23.825913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6977e9b9-e0ff-4602-9ed6-d55f4ff5b9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:23.841823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:30:23.856435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6977e9b9-e0ff-4602-9ed6-d55f4ff5b9d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Aug 22 19:30:23.857003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 593/1086] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:23.861491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-20aadb4e-a8fd-415d-9429-4d1e3088e2cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:23.863664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-20aadb4e-a8fd-415d-9429-4d1e3088e2cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:23.869316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20aadb4e-a8fd-415d-9429-4d1e3088e2cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:23.869798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20aadb4e-a8fd-415d-9429-4d1e3088e2cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:23.870234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20aadb4e-a8fd-415d-9429-4d1e3088e2cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:23.870931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20aadb4e-a8fd-415d-9429-4d1e3088e2cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:23.871384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20aadb4e-a8fd-415d-9429-4d1e3088e2cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:23.871846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20aadb4e-a8fd-415d-9429-4d1e3088e2cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:23.903601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-20aadb4e-a8fd-415d-9429-4d1e3088e2cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 Aug 22 19:30:23.904298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 594/1087] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:23 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:24.830961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:24.831671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:24.837928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:24.838405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:24.838835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:24.839517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:24.839989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:24.840410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:24.901538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:24.910294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-62e3bf5b-c615-4643-afae-ea7d3f335b28 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.083621 Aug 22 19:30:24.910887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 595/1088] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:24 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:24.915943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-583323bc-b25d-489d-bf7f-7989dd8e29d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:24.918001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-583323bc-b25d-489d-bf7f-7989dd8e29d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:24.924787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-583323bc-b25d-489d-bf7f-7989dd8e29d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:24.925275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-583323bc-b25d-489d-bf7f-7989dd8e29d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:24.925714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-583323bc-b25d-489d-bf7f-7989dd8e29d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:24.926429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-583323bc-b25d-489d-bf7f-7989dd8e29d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:24.926883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-583323bc-b25d-489d-bf7f-7989dd8e29d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:24.927311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-583323bc-b25d-489d-bf7f-7989dd8e29d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:24.959127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-583323bc-b25d-489d-bf7f-7989dd8e29d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047085 Aug 22 19:30:24.959702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 596/1089] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:24.964236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-94321e35-2a1a-4bc2-ac6c-21df50e228af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:24.966407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-94321e35-2a1a-4bc2-ac6c-21df50e228af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:24.973092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94321e35-2a1a-4bc2-ac6c-21df50e228af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:24.973599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94321e35-2a1a-4bc2-ac6c-21df50e228af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:24.974034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94321e35-2a1a-4bc2-ac6c-21df50e228af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:24.974726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94321e35-2a1a-4bc2-ac6c-21df50e228af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:24.975176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94321e35-2a1a-4bc2-ac6c-21df50e228af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:24.975595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94321e35-2a1a-4bc2-ac6c-21df50e228af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:25.003318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-94321e35-2a1a-4bc2-ac6c-21df50e228af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 Aug 22 19:30:25.003914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 597/1090] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:24 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:25.930288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:25.930911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:25.938466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:25.938948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:25.939434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:25.940167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:25.940616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:25.941041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:25.945005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:30:26.010862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:26.024150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-97adfff7-333f-486a-904c-b85a0e479d06 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.097609 Aug 22 19:30:26.024712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 598/1091] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:25 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:26.029263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fb425524-a047-4676-a82a-eb8738526f2d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:26.031430 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fb425524-a047-4676-a82a-eb8738526f2d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:26.037611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb425524-a047-4676-a82a-eb8738526f2d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:26.038087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb425524-a047-4676-a82a-eb8738526f2d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:26.038516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb425524-a047-4676-a82a-eb8738526f2d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:26.039206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb425524-a047-4676-a82a-eb8738526f2d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:26.043735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb425524-a047-4676-a82a-eb8738526f2d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:26.046749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb425524-a047-4676-a82a-eb8738526f2d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:26.075620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fb425524-a047-4676-a82a-eb8738526f2d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049907 Aug 22 19:30:26.076189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 599/1092] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:26 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:26.081282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-58c7db37-1d24-4a8f-9639-a7a79eba0f5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:26.083396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-58c7db37-1d24-4a8f-9639-a7a79eba0f5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:26.089140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c7db37-1d24-4a8f-9639-a7a79eba0f5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:26.089612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c7db37-1d24-4a8f-9639-a7a79eba0f5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:26.090037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c7db37-1d24-4a8f-9639-a7a79eba0f5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:26.090719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c7db37-1d24-4a8f-9639-a7a79eba0f5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:26.091163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c7db37-1d24-4a8f-9639-a7a79eba0f5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:26.091576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c7db37-1d24-4a8f-9639-a7a79eba0f5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:26.121333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-58c7db37-1d24-4a8f-9639-a7a79eba0f5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Aug 22 19:30:26.121897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 600/1093] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:26 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:27.044616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:27.045413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:27.051740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:27.052224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:27.052656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:27.053343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:27.053794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:27.054238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:27.117150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:27.124941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b3f7336d-2f60-466c-b42b-fe702a1e4a82 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084361 Aug 22 19:30:27.125508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 601/1094] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:27 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:27.130051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e1cc3af1-4503-4ed1-8273-ff67f8bcb05d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:27.132213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e1cc3af1-4503-4ed1-8273-ff67f8bcb05d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:27.138107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1cc3af1-4503-4ed1-8273-ff67f8bcb05d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:27.138589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1cc3af1-4503-4ed1-8273-ff67f8bcb05d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:27.139023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1cc3af1-4503-4ed1-8273-ff67f8bcb05d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:27.140258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1cc3af1-4503-4ed1-8273-ff67f8bcb05d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:27.140721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1cc3af1-4503-4ed1-8273-ff67f8bcb05d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:27.141141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1cc3af1-4503-4ed1-8273-ff67f8bcb05d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:27.170605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e1cc3af1-4503-4ed1-8273-ff67f8bcb05d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Aug 22 19:30:27.171194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 602/1095] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:27.175851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-18a721e5-925d-45a9-997e-613e24764481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:27.177938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-18a721e5-925d-45a9-997e-613e24764481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:27.183829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18a721e5-925d-45a9-997e-613e24764481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:27.184304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18a721e5-925d-45a9-997e-613e24764481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:27.184739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18a721e5-925d-45a9-997e-613e24764481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:27.185428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18a721e5-925d-45a9-997e-613e24764481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:27.185878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18a721e5-925d-45a9-997e-613e24764481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:27.186298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18a721e5-925d-45a9-997e-613e24764481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:27.215054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-18a721e5-925d-45a9-997e-613e24764481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042822 Aug 22 19:30:27.215611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 603/1096] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:27 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:28.150203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:28.151365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:28.160163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:28.160647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:28.161077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:28.161773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:28.162218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:28.162636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:28.229314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:28.237935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-17105542-1787-4964-9eb8-99688bfda57c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.096184 Aug 22 19:30:28.238514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 604/1097] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:28 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:28.243263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-40657d0f-a913-4dfe-9c0f-87f8dfe7677a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:28.245488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-40657d0f-a913-4dfe-9c0f-87f8dfe7677a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:28.251778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40657d0f-a913-4dfe-9c0f-87f8dfe7677a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:28.252269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40657d0f-a913-4dfe-9c0f-87f8dfe7677a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:28.252706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40657d0f-a913-4dfe-9c0f-87f8dfe7677a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:28.253459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40657d0f-a913-4dfe-9c0f-87f8dfe7677a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:28.253870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40657d0f-a913-4dfe-9c0f-87f8dfe7677a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:28.254297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40657d0f-a913-4dfe-9c0f-87f8dfe7677a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:28.285953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-40657d0f-a913-4dfe-9c0f-87f8dfe7677a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046368 Aug 22 19:30:28.286541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 605/1098] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:28.291251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2336a43f-88b1-49d8-b8c8-fa2a11fc9050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:28.293617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2336a43f-88b1-49d8-b8c8-fa2a11fc9050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:28.300354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2336a43f-88b1-49d8-b8c8-fa2a11fc9050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:28.300846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2336a43f-88b1-49d8-b8c8-fa2a11fc9050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:28.301284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2336a43f-88b1-49d8-b8c8-fa2a11fc9050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:28.302015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2336a43f-88b1-49d8-b8c8-fa2a11fc9050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:28.302512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2336a43f-88b1-49d8-b8c8-fa2a11fc9050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:28.302932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2336a43f-88b1-49d8-b8c8-fa2a11fc9050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:28.332018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2336a43f-88b1-49d8-b8c8-fa2a11fc9050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Aug 22 19:30:28.332917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 606/1099] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:28 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:29.260036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:29.261100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:29.268038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:29.268581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:29.269069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:29.269839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:29.270338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:29.270860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:29.347202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:29.355544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fcb22621-3f78-4f41-96d9-d2e3f396fdbe tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.100082 Aug 22 19:30:29.356174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 607/1100] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:29 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:29.361613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5d0ff0b6-82eb-47c4-8f8f-048718f3675c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:29.363831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5d0ff0b6-82eb-47c4-8f8f-048718f3675c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:29.372337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d0ff0b6-82eb-47c4-8f8f-048718f3675c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:29.372337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d0ff0b6-82eb-47c4-8f8f-048718f3675c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:29.372337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d0ff0b6-82eb-47c4-8f8f-048718f3675c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:29.372337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d0ff0b6-82eb-47c4-8f8f-048718f3675c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:29.372949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d0ff0b6-82eb-47c4-8f8f-048718f3675c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:29.373043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5d0ff0b6-82eb-47c4-8f8f-048718f3675c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:29.404646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5d0ff0b6-82eb-47c4-8f8f-048718f3675c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047275 Aug 22 19:30:29.405148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 608/1101] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:29.409985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f3c8420b-44eb-4c53-9992-97fc829d8213 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:29.412296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f3c8420b-44eb-4c53-9992-97fc829d8213 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:29.419362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c8420b-44eb-4c53-9992-97fc829d8213 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:29.419870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c8420b-44eb-4c53-9992-97fc829d8213 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:29.420306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c8420b-44eb-4c53-9992-97fc829d8213 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:29.421023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c8420b-44eb-4c53-9992-97fc829d8213 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:29.422027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c8420b-44eb-4c53-9992-97fc829d8213 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:29.422453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3c8420b-44eb-4c53-9992-97fc829d8213 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:29.458335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f3c8420b-44eb-4c53-9992-97fc829d8213 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052091 Aug 22 19:30:29.459037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 609/1102] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:29 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:30.379020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:30.379742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:30.386380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:30.386881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:30.387321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:30.388066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:30.388514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:30.388954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:30.469333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:30.477583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2a3168e5-d67f-48af-94db-4a4bb6765f94 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.103971 Aug 22 19:30:30.478173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 610/1103] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:30 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:30:30.483107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bfaccfec-f547-427f-afa5-ae4ac272dcdc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:30.485289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bfaccfec-f547-427f-afa5-ae4ac272dcdc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:30.491956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfaccfec-f547-427f-afa5-ae4ac272dcdc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:30.492443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfaccfec-f547-427f-afa5-ae4ac272dcdc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:30.492871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfaccfec-f547-427f-afa5-ae4ac272dcdc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:30.493561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfaccfec-f547-427f-afa5-ae4ac272dcdc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:30.494007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfaccfec-f547-427f-afa5-ae4ac272dcdc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:30.494426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfaccfec-f547-427f-afa5-ae4ac272dcdc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:30.526118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bfaccfec-f547-427f-afa5-ae4ac272dcdc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046902 Aug 22 19:30:30.526685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 611/1104] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:30 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:30.531338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-867531ea-d3de-4753-b1f9-c0c694a4ab2e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:30.533515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-867531ea-d3de-4753-b1f9-c0c694a4ab2e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:30.539572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-867531ea-d3de-4753-b1f9-c0c694a4ab2e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:30.540084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-867531ea-d3de-4753-b1f9-c0c694a4ab2e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:30.540511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-867531ea-d3de-4753-b1f9-c0c694a4ab2e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:30.541199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-867531ea-d3de-4753-b1f9-c0c694a4ab2e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:30.541637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-867531ea-d3de-4753-b1f9-c0c694a4ab2e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:30.542052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-867531ea-d3de-4753-b1f9-c0c694a4ab2e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:30.571464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-867531ea-d3de-4753-b1f9-c0c694a4ab2e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Aug 22 19:30:30.572066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 612/1105] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:30 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:31.500122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:31.500993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:31.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:31.508499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:31.508976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:31.509692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:31.510389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:31.510756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:31.581961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:31.590371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2235e02f-14e8-4ca2-9a52-eeb26f607af0 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.094403 Aug 22 19:30:31.590956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 613/1106] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:31 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:31.596505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4ceb3c60-84df-40b6-9718-5d9741626570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:31.598665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4ceb3c60-84df-40b6-9718-5d9741626570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:31.601629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:30:31.605760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ceb3c60-84df-40b6-9718-5d9741626570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:31.606240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ceb3c60-84df-40b6-9718-5d9741626570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:31.606672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ceb3c60-84df-40b6-9718-5d9741626570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:31.607380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ceb3c60-84df-40b6-9718-5d9741626570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:31.607891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ceb3c60-84df-40b6-9718-5d9741626570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:31.608312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ceb3c60-84df-40b6-9718-5d9741626570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:31.634218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:30:31.639559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4ceb3c60-84df-40b6-9718-5d9741626570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047601 Aug 22 19:30:31.640688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 614/1107] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:31.645680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-75ac8ed7-8808-41b0-aaae-cb6955d990f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:31.647887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-75ac8ed7-8808-41b0-aaae-cb6955d990f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:31.654362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75ac8ed7-8808-41b0-aaae-cb6955d990f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:31.654847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75ac8ed7-8808-41b0-aaae-cb6955d990f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:31.655279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75ac8ed7-8808-41b0-aaae-cb6955d990f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:31.656733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75ac8ed7-8808-41b0-aaae-cb6955d990f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:31.657360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75ac8ed7-8808-41b0-aaae-cb6955d990f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:31.657886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75ac8ed7-8808-41b0-aaae-cb6955d990f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:31.695908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-75ac8ed7-8808-41b0-aaae-cb6955d990f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053745 Aug 22 19:30:31.696920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 615/1108] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:31 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:32.616946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:32.617707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:32.624916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:32.625408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:32.625850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:32.626566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:32.627031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:32.627458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:32.696899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:32.705349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-87b3b95c-2ff0-46d1-a971-67decfb5dbec tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.096994 Aug 22 19:30:32.706100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 616/1109] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:32 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:30:32.710790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b5574a04-ac79-474d-ad86-a5d993972056 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:32.713333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b5574a04-ac79-474d-ad86-a5d993972056 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:32.720770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5574a04-ac79-474d-ad86-a5d993972056 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:32.721264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5574a04-ac79-474d-ad86-a5d993972056 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:32.721703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5574a04-ac79-474d-ad86-a5d993972056 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:32.722424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5574a04-ac79-474d-ad86-a5d993972056 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:32.722876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5574a04-ac79-474d-ad86-a5d993972056 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:32.723315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5574a04-ac79-474d-ad86-a5d993972056 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:32.779317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b5574a04-ac79-474d-ad86-a5d993972056 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071867 Aug 22 19:30:32.780424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 617/1110] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:32.787184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b15f0c43-54a2-48bd-8f57-238c4a026cb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:32.789397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b15f0c43-54a2-48bd-8f57-238c4a026cb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:32.795683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b15f0c43-54a2-48bd-8f57-238c4a026cb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:32.796856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b15f0c43-54a2-48bd-8f57-238c4a026cb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:32.797496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b15f0c43-54a2-48bd-8f57-238c4a026cb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:32.798302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b15f0c43-54a2-48bd-8f57-238c4a026cb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:32.798844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b15f0c43-54a2-48bd-8f57-238c4a026cb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:32.799361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b15f0c43-54a2-48bd-8f57-238c4a026cb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:32.831510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b15f0c43-54a2-48bd-8f57-238c4a026cb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049038 Aug 22 19:30:32.832142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 618/1111] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:32 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:33.735080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:33.735823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:33.742286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:33.742765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:33.743204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:33.743942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:33.744515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:33.744978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:33.809855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:33.818841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fd361c78-ffb8-484a-9077-44bda507cee9 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.088033 Aug 22 19:30:33.819414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 619/1112] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:33 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:33.824112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-94d6e17a-177a-47bb-b19e-278546bd5a9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:33.826261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-94d6e17a-177a-47bb-b19e-278546bd5a9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:33.832251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94d6e17a-177a-47bb-b19e-278546bd5a9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:33.832729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94d6e17a-177a-47bb-b19e-278546bd5a9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:33.833157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94d6e17a-177a-47bb-b19e-278546bd5a9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:33.833852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94d6e17a-177a-47bb-b19e-278546bd5a9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:33.834296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94d6e17a-177a-47bb-b19e-278546bd5a9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:33.834713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94d6e17a-177a-47bb-b19e-278546bd5a9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:33.868453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-94d6e17a-177a-47bb-b19e-278546bd5a9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047938 Aug 22 19:30:33.869025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 620/1113] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:33 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:33.873655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6eab7659-5544-4683-9216-f192a06fd83a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:33.876397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6eab7659-5544-4683-9216-f192a06fd83a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:33.882362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eab7659-5544-4683-9216-f192a06fd83a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:33.882844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eab7659-5544-4683-9216-f192a06fd83a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:33.883276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eab7659-5544-4683-9216-f192a06fd83a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:33.884008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eab7659-5544-4683-9216-f192a06fd83a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:33.884459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eab7659-5544-4683-9216-f192a06fd83a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:33.884876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eab7659-5544-4683-9216-f192a06fd83a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:33.922233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6eab7659-5544-4683-9216-f192a06fd83a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052160 Aug 22 19:30:33.922802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 621/1114] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:33 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:34.840018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:34.841129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:34.847808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:34.848307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:34.848748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:34.849459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:34.849911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:34.850335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:34.913942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:34.923130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-67d146a8-1756-463e-992e-425ad4d9cdc4 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.086954 Aug 22 19:30:34.923729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 622/1115] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:34 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:34.928381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-45d617e9-ff79-46f8-ac93-fac2bfd9572e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:34.930535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-45d617e9-ff79-46f8-ac93-fac2bfd9572e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:34.939923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45d617e9-ff79-46f8-ac93-fac2bfd9572e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:34.940410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45d617e9-ff79-46f8-ac93-fac2bfd9572e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:34.940843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45d617e9-ff79-46f8-ac93-fac2bfd9572e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:34.941553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45d617e9-ff79-46f8-ac93-fac2bfd9572e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:34.942000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45d617e9-ff79-46f8-ac93-fac2bfd9572e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:34.942424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45d617e9-ff79-46f8-ac93-fac2bfd9572e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:34.974180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-45d617e9-ff79-46f8-ac93-fac2bfd9572e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049384 Aug 22 19:30:34.974770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 623/1116] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:34.979455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e3ad99f6-9bce-4f44-9135-847d4f4c7235 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:34.981678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e3ad99f6-9bce-4f44-9135-847d4f4c7235 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:34.987875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3ad99f6-9bce-4f44-9135-847d4f4c7235 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:34.988357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3ad99f6-9bce-4f44-9135-847d4f4c7235 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:34.988794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3ad99f6-9bce-4f44-9135-847d4f4c7235 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:34.989510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3ad99f6-9bce-4f44-9135-847d4f4c7235 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:34.989958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3ad99f6-9bce-4f44-9135-847d4f4c7235 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:34.990379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3ad99f6-9bce-4f44-9135-847d4f4c7235 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:35.022091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e3ad99f6-9bce-4f44-9135-847d4f4c7235 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Aug 22 19:30:35.022669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 624/1117] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:34 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:35.945200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:35.945906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:35.952334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:35.952899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:35.953334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:35.954022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:35.954460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:35.954873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:36.022669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:36.034390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9983a436-5966-4586-9620-ef28e543da84 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.092791 Aug 22 19:30:36.035195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 625/1118] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:35 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:36.042021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e3cf2b7d-e834-4c55-82e4-335af4a6557c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:36.045347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e3cf2b7d-e834-4c55-82e4-335af4a6557c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:36.052741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3cf2b7d-e834-4c55-82e4-335af4a6557c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:36.053218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3cf2b7d-e834-4c55-82e4-335af4a6557c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:36.053647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3cf2b7d-e834-4c55-82e4-335af4a6557c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:36.054348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3cf2b7d-e834-4c55-82e4-335af4a6557c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:36.054816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3cf2b7d-e834-4c55-82e4-335af4a6557c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:36.055215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3cf2b7d-e834-4c55-82e4-335af4a6557c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:36.099022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e3cf2b7d-e834-4c55-82e4-335af4a6557c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062534 Aug 22 19:30:36.099622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 626/1119] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:36.104510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c2e18c45-519a-4867-b474-25fbf51118cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:36.106657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c2e18c45-519a-4867-b474-25fbf51118cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:36.113508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2e18c45-519a-4867-b474-25fbf51118cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:36.114022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2e18c45-519a-4867-b474-25fbf51118cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:36.114603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2e18c45-519a-4867-b474-25fbf51118cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:36.115348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2e18c45-519a-4867-b474-25fbf51118cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:36.115826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2e18c45-519a-4867-b474-25fbf51118cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:36.116252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2e18c45-519a-4867-b474-25fbf51118cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:36.157292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c2e18c45-519a-4867-b474-25fbf51118cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056312 Aug 22 19:30:36.157800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 627/1120] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:36 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:37.056321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:37.057031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:37.064823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:37.065390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:37.065973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:37.066813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:37.067407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:37.067940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:37.139673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:37.148384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-79da4d33-90a7-4658-9e94-5374c3218d20 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.095960 Aug 22 19:30:37.148938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 628/1121] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:37 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:37.153605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-28bfbf37-c00f-4859-a1e2-9fe82b9990e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:37.155857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-28bfbf37-c00f-4859-a1e2-9fe82b9990e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:37.161840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28bfbf37-c00f-4859-a1e2-9fe82b9990e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:37.162321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28bfbf37-c00f-4859-a1e2-9fe82b9990e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:37.162754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28bfbf37-c00f-4859-a1e2-9fe82b9990e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:37.163442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28bfbf37-c00f-4859-a1e2-9fe82b9990e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:37.163908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28bfbf37-c00f-4859-a1e2-9fe82b9990e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:37.164333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28bfbf37-c00f-4859-a1e2-9fe82b9990e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:37.194781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-28bfbf37-c00f-4859-a1e2-9fe82b9990e6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Aug 22 19:30:37.195353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 629/1122] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:37 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:37.200003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1aff3d33-df66-4af1-ab6b-1ff873a735cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:37.202157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1aff3d33-df66-4af1-ab6b-1ff873a735cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:37.216026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aff3d33-df66-4af1-ab6b-1ff873a735cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:37.216513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aff3d33-df66-4af1-ab6b-1ff873a735cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:37.216946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aff3d33-df66-4af1-ab6b-1ff873a735cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:37.217636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aff3d33-df66-4af1-ab6b-1ff873a735cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:37.218620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aff3d33-df66-4af1-ab6b-1ff873a735cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:37.219045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aff3d33-df66-4af1-ab6b-1ff873a735cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:37.249133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1aff3d33-df66-4af1-ab6b-1ff873a735cd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052699 Aug 22 19:30:37.249715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 630/1123] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:37 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:38.169331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:38.170409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:38.177016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:38.177493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:38.177922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:38.178615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:38.179057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:38.179473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:38.198336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:30:38.243513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:38.252676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c8ff1922-4458-4b0e-9a05-0a30aba6e178 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.087174 Aug 22 19:30:38.253271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 631/1124] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:38 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:38.258309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-209c5efe-406a-4545-8c61-4801a0c56cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:38.260817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-209c5efe-406a-4545-8c61-4801a0c56cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:38.266894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-209c5efe-406a-4545-8c61-4801a0c56cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:38.267405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-209c5efe-406a-4545-8c61-4801a0c56cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:38.267882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-209c5efe-406a-4545-8c61-4801a0c56cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:38.268588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-209c5efe-406a-4545-8c61-4801a0c56cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:38.269047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-209c5efe-406a-4545-8c61-4801a0c56cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:38.269469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-209c5efe-406a-4545-8c61-4801a0c56cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:38.300375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-209c5efe-406a-4545-8c61-4801a0c56cf4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046051 Aug 22 19:30:38.300952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 632/1125] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:38.305564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9a78d4f9-7148-4e84-a77d-a22e9ea6ad9f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:38.307721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9a78d4f9-7148-4e84-a77d-a22e9ea6ad9f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:38.314388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a78d4f9-7148-4e84-a77d-a22e9ea6ad9f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:38.314868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a78d4f9-7148-4e84-a77d-a22e9ea6ad9f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:38.315307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a78d4f9-7148-4e84-a77d-a22e9ea6ad9f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:38.316048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a78d4f9-7148-4e84-a77d-a22e9ea6ad9f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:38.316498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a78d4f9-7148-4e84-a77d-a22e9ea6ad9f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:38.316924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a78d4f9-7148-4e84-a77d-a22e9ea6ad9f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:38.347570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9a78d4f9-7148-4e84-a77d-a22e9ea6ad9f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045565 Aug 22 19:30:38.348171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 633/1126] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:38 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:39.272399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:39.273063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:39.279544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:39.280065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:39.280509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:39.281946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:39.282532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:39.283528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:39.345538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:39.353780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fce8dc4a-617f-4dfd-a2bd-4b44383b7be3 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.084868 Aug 22 19:30:39.354876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 634/1127] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:39 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:39.359325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a2d5d610-e9d3-4ab6-abe1-04357e3f6aa8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:39.361491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a2d5d610-e9d3-4ab6-abe1-04357e3f6aa8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:39.367926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2d5d610-e9d3-4ab6-abe1-04357e3f6aa8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:39.368345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2d5d610-e9d3-4ab6-abe1-04357e3f6aa8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:39.368815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2d5d610-e9d3-4ab6-abe1-04357e3f6aa8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:39.369521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2d5d610-e9d3-4ab6-abe1-04357e3f6aa8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:39.369972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2d5d610-e9d3-4ab6-abe1-04357e3f6aa8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:39.370428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2d5d610-e9d3-4ab6-abe1-04357e3f6aa8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:39.403519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a2d5d610-e9d3-4ab6-abe1-04357e3f6aa8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047667 Aug 22 19:30:39.404027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 635/1128] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:39.408635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-214929b9-230d-43ba-90a8-fc191f921bfe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:39.410761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-214929b9-230d-43ba-90a8-fc191f921bfe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:39.416770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-214929b9-230d-43ba-90a8-fc191f921bfe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:39.417251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-214929b9-230d-43ba-90a8-fc191f921bfe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:39.417687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-214929b9-230d-43ba-90a8-fc191f921bfe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:39.418393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-214929b9-230d-43ba-90a8-fc191f921bfe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:39.418849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-214929b9-230d-43ba-90a8-fc191f921bfe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:39.419273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-214929b9-230d-43ba-90a8-fc191f921bfe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:39.449523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-214929b9-230d-43ba-90a8-fc191f921bfe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044393 Aug 22 19:30:39.450084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 636/1129] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:39 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:40.374388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:40.375100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:40.382491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:40.383004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:40.383443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:40.384189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:40.384642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:40.385084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:40.457393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:30:40.466303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f7ff812f-a15e-43cc-82ff-1b4feb68305c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.095742 Aug 22 19:30:40.466889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 637/1130] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:30:40 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:30:40.472843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0111bfee-a2b1-476d-9715-1b3ac8955519 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:40.475029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0111bfee-a2b1-476d-9715-1b3ac8955519 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:40.481794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0111bfee-a2b1-476d-9715-1b3ac8955519 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:40.482785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0111bfee-a2b1-476d-9715-1b3ac8955519 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:40.482991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0111bfee-a2b1-476d-9715-1b3ac8955519 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:40.483682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0111bfee-a2b1-476d-9715-1b3ac8955519 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:40.484172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0111bfee-a2b1-476d-9715-1b3ac8955519 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:40.484997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0111bfee-a2b1-476d-9715-1b3ac8955519 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:40.516502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0111bfee-a2b1-476d-9715-1b3ac8955519 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048534 Aug 22 19:30:40.517073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 638/1131] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:40.521721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5f4de38f-cc84-4916-8d15-c917b424dd41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:40.523950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5f4de38f-cc84-4916-8d15-c917b424dd41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:40.529976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4de38f-cc84-4916-8d15-c917b424dd41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:40.530461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4de38f-cc84-4916-8d15-c917b424dd41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:40.531490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4de38f-cc84-4916-8d15-c917b424dd41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:40.532225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4de38f-cc84-4916-8d15-c917b424dd41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:40.532678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4de38f-cc84-4916-8d15-c917b424dd41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:40.533108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4de38f-cc84-4916-8d15-c917b424dd41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:40.564943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5f4de38f-cc84-4916-8d15-c917b424dd41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Aug 22 19:30:40.565532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 639/1132] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:30:40 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:30:40.965938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:30:40.966430 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:30:40.975144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:40.975626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:40.976086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:40.976792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:30:40.977245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:30:40.977659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:30:50.971174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=52 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:30:50.999320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=54 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:31:13.985297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:31:13.986000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:31:41.299038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55f31e92-3766-4d77-a605-7016b5ffd592) Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 HTTP/1.1 Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:31:41.302009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:31:41.303698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55f31e92-3766-4d77-a605-7016b5ffd592) Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'server_id': 'f6744e43-5389-4422-9030-dfdf1b522dcc', 'id': 'eb79d8da-4f31-4277-89a4-336e11f55658'} Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:31:41.304568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55f31e92-3766-4d77-a605-7016b5ffd592) Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:31:41.305703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55f31e92-3766-4d77-a605-7016b5ffd592) Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:31:41.306935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55f31e92-3766-4d77-a605-7016b5ffd592) Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:31:41.309099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55f31e92-3766-4d77-a605-7016b5ffd592) Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55f31e92-3766-4d77-a605-7016b5ffd592) Aug 22 19:31:41.310785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:31:41.312392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55f31e92-3766-4d77-a605-7016b5ffd592) {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:31:41.312392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d77d141-5f5c-41a6-ae89-51e83de9d3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 400 len: 269 microversion: 2.1 time: 120.147828 Aug 22 19:31:41.312392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 494/1133] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:29:41 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 269 bytes in 120149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:31:41.384037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:31:41.384748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:31:41.391342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:31:41.391865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:31:41.392302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:31:41.393010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:31:41.393463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:31:41.393891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:31:41.420990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'services' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:31:41.482419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:31:41.494598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0e56d31-c18b-4ef6-94cc-c4e982a2ca0c tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.189023 Aug 22 19:31:41.495325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 495/1134] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:31:41 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:31:41.501291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91c7e5b0-3749-4f2d-8e68-2b532391ec80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:31:41.504039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91c7e5b0-3749-4f2d-8e68-2b532391ec80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:31:41.510839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7e5b0-3749-4f2d-8e68-2b532391ec80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:31:41.511370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7e5b0-3749-4f2d-8e68-2b532391ec80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:31:41.511998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7e5b0-3749-4f2d-8e68-2b532391ec80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:31:41.512696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7e5b0-3749-4f2d-8e68-2b532391ec80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:31:41.513149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7e5b0-3749-4f2d-8e68-2b532391ec80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:31:41.513574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7e5b0-3749-4f2d-8e68-2b532391ec80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:31:41.543088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91c7e5b0-3749-4f2d-8e68-2b532391ec80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046346 Aug 22 19:31:41.543655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 496/1135] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:31:41 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:31:41.548182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a116605-40b6-46f2-aa54-245dd612b23c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:31:41.550286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a116605-40b6-46f2-aa54-245dd612b23c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:31:41.556180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a116605-40b6-46f2-aa54-245dd612b23c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:31:41.556663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a116605-40b6-46f2-aa54-245dd612b23c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:31:41.557094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a116605-40b6-46f2-aa54-245dd612b23c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:31:41.557793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a116605-40b6-46f2-aa54-245dd612b23c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:31:41.558242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a116605-40b6-46f2-aa54-245dd612b23c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:31:41.558666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a116605-40b6-46f2-aa54-245dd612b23c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:31:41.587990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a116605-40b6-46f2-aa54-245dd612b23c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043268 Aug 22 19:31:41.588553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 497/1136] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:31:41 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:31:41.593091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:31:41.593842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:31:41.599602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:31:41.600119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:31:41.600549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:31:41.601240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:31:41.601714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:31:41.602116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:31:44.908422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:31:44.909210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:31:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:31:48.256763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:31:48.257427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:31:51.427852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:31:51.597230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:31:51.620688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=22 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:32:03.800471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:32:03.801757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:32:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:32:13.983117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a6bd0b-d094-4402-9cc1-92d5894de1cd) Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 HTTP/1.1 Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:32:13.985384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:32:13.987155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a6bd0b-d094-4402-9cc1-92d5894de1cd) Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': 'f6744e43-5389-4422-9030-dfdf1b522dcc', 'id': 'eb79d8da-4f31-4277-89a4-336e11f55658'} Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:32:13.988135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a6bd0b-d094-4402-9cc1-92d5894de1cd) Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:32:13.989272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a6bd0b-d094-4402-9cc1-92d5894de1cd) Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:32:13.990494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a6bd0b-d094-4402-9cc1-92d5894de1cd) Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:32:13.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a6bd0b-d094-4402-9cc1-92d5894de1cd) Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a6bd0b-d094-4402-9cc1-92d5894de1cd) Aug 22 19:32:13.992832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:32:13.994072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a6bd0b-d094-4402-9cc1-92d5894de1cd) {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:32:13.994072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cbe9847f-2064-4d29-9277-8e6e08c4281f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 400 len: 269 microversion: 2.1 time: 93.025027 Aug 22 19:32:13.994072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 640/1137] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:30:40 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 269 bytes in 93026 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 19:32:13.998245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:32:13.998745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:32:14.004742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:32:14.005229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:32:14.005667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:32:14.006366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:32:14.006931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:32:14.007683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:32:14.085323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'services' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:32:24.002448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:32:24.025946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:32:24.090264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:33:27.222079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:33:27.222740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:33:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d (ip 10.222.0.61) !!! Aug 22 19:33:41.753640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lazy-loading 'services' on Instance uuid 0b81f37d-80e6-429a-9afd-79fccb869bde {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:33:41.787280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79b73719-6582-480c-83ad-7240232ffad8) Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 HTTP/1.1 Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:33:41.790313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:33:41.792027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79b73719-6582-480c-83ad-7240232ffad8) Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'server_id': 'f6744e43-5389-4422-9030-dfdf1b522dcc', 'id': 'eb79d8da-4f31-4277-89a4-336e11f55658'} Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:33:41.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79b73719-6582-480c-83ad-7240232ffad8) Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:33:41.794734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79b73719-6582-480c-83ad-7240232ffad8) Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:33:41.796195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79b73719-6582-480c-83ad-7240232ffad8) Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:33:41.797526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79b73719-6582-480c-83ad-7240232ffad8) Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79b73719-6582-480c-83ad-7240232ffad8) Aug 22 19:33:41.798899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:33:41.800620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-79b73719-6582-480c-83ad-7240232ffad8) {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:33:41.800620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6f1e04b-47d4-4d28-b1de-517f5f7a3b91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 400 len: 269 microversion: 2.1 time: 120.202499 Aug 22 19:33:41.800620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 498/1138] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:31:41 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 269 bytes in 120204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:33:41.800620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:33:41.801108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:33:41.807422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:41.807942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:41.808407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:41.809110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:41.809863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:41.810302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:41.877866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:33:41.886454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c6da9a1-354d-4410-ba73-17542f4bd9e1 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.092524 Aug 22 19:33:41.887030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 499/1139] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:33:41 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:33:42.013515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-230e6687-e1e0-4f11-b48e-bc1def7eea28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:33:42.016480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-230e6687-e1e0-4f11-b48e-bc1def7eea28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:33:42.022627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230e6687-e1e0-4f11-b48e-bc1def7eea28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:42.023109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230e6687-e1e0-4f11-b48e-bc1def7eea28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:42.023573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230e6687-e1e0-4f11-b48e-bc1def7eea28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:42.024301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230e6687-e1e0-4f11-b48e-bc1def7eea28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:42.024748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230e6687-e1e0-4f11-b48e-bc1def7eea28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:42.025170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230e6687-e1e0-4f11-b48e-bc1def7eea28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:42.057922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-230e6687-e1e0-4f11-b48e-bc1def7eea28 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169781 Aug 22 19:33:42.058516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 500/1140] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:33:41 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:33:42.205251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a17546e1-e090-48b4-8a10-84e10940b6ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:33:42.207444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a17546e1-e090-48b4-8a10-84e10940b6ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:33:42.213731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a17546e1-e090-48b4-8a10-84e10940b6ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:42.214218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a17546e1-e090-48b4-8a10-84e10940b6ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:42.214651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a17546e1-e090-48b4-8a10-84e10940b6ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:42.215355 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a17546e1-e090-48b4-8a10-84e10940b6ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:42.215864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a17546e1-e090-48b4-8a10-84e10940b6ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:42.216557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a17546e1-e090-48b4-8a10-84e10940b6ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:42.247047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a17546e1-e090-48b4-8a10-84e10940b6ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187403 Aug 22 19:33:42.247528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 501/1141] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:33:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:33:42.252272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb116ae8-2112-40f5-9a06-a188b6620081 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:33:42.254375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb116ae8-2112-40f5-9a06-a188b6620081 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:33:42.260312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb116ae8-2112-40f5-9a06-a188b6620081 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:42.260798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb116ae8-2112-40f5-9a06-a188b6620081 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:42.261237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb116ae8-2112-40f5-9a06-a188b6620081 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:42.261972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb116ae8-2112-40f5-9a06-a188b6620081 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:42.262423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb116ae8-2112-40f5-9a06-a188b6620081 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:42.262844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb116ae8-2112-40f5-9a06-a188b6620081 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:42.292597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb116ae8-2112-40f5-9a06-a188b6620081 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Aug 22 19:33:42.293362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 502/1142] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:33:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:33:42.299004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:33:42.300032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:33:42.306325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:42.306771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:42.307269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:42.308013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:33:42.308483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:33:42.308968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:33:44.589377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:33:44.589989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:33:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d (ip 10.222.0.61) !!! Aug 22 19:33:51.758292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:33:52.304110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:33:52.327757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=28 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:34:14.165141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3f1c9386-cd70-45f6-a9f3-dca8c0c431af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d" status: 202 len: 0 microversion: 2.1 time: 120.175268 Aug 22 19:34:14.165739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 641/1143] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:32:13 2022] DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d => generated 0 bytes in 120178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:34:14.171602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:34:14.172207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:34:14.178424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:34:14.178906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:34:14.179535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:34:14.180498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:34:14.181272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:34:14.181848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:34:14.214999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'services' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:34:24.176185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:34:24.200828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:34:24.220506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:34:33.994394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:34:33.995004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:34:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d (ip 10.222.0.61) !!! Aug 22 19:35:04.916717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:35:04.917440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:35:08.265915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:35:08.266554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:35:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:35:23.810261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:35:23.810934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:35:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 (ip 10.222.0.61) !!! Aug 22 19:35:41.869044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lazy-loading 'services' on Instance uuid 0b81f37d-80e6-429a-9afd-79fccb869bde {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:35:42.058520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f186a8f3-cdfc-44c7-a997-ce19a0c63d16) Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 HTTP/1.1 Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:35:42.060753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:35:42.062694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f186a8f3-cdfc-44c7-a997-ce19a0c63d16) Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'server_id': 'f6744e43-5389-4422-9030-dfdf1b522dcc', 'id': 'eb79d8da-4f31-4277-89a4-336e11f55658'} Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:35:42.063829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f186a8f3-cdfc-44c7-a997-ce19a0c63d16) Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:35:42.065789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f186a8f3-cdfc-44c7-a997-ce19a0c63d16) Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.067253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f186a8f3-cdfc-44c7-a997-ce19a0c63d16) Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:35:42.069082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f186a8f3-cdfc-44c7-a997-ce19a0c63d16) Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f186a8f3-cdfc-44c7-a997-ce19a0c63d16) Aug 22 19:35:42.070320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.071410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f186a8f3-cdfc-44c7-a997-ce19a0c63d16) {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:35:42.071410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-541dcc69-d15a-41d7-a6eb-67943d25d341 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 400 len: 269 microversion: 2.1 time: 119.768124 Aug 22 19:35:42.071410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 503/1144] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:33:42 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 269 bytes in 119769 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:35:42.075800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.076424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.083344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.083953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.085109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.085907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.086489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.086994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.101888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93dd5896-a06d-4149-8a08-88948e274210) Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Request method failure captured: Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d HTTP/1.1 Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9dlSpq0-pyeFPmh5ASmV5GrMo7tFhVWavh7rWYrq7NWCOVOBV_aIffmUE_yD2yos3RCOrL-zu0c3cZ_HnbNmqCoDxzUAF_LUjcWnD9XRTEMfLMYLrNcSYW6fuRdP06nAjQO7HuzGCFmEho8SlgrWT90nJvB4Mv5BLp4KS2fFbRCUig Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:35:42.104353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}] Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: aa9a0d600b1c42ec8fbb6710744bbd1d Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:35:42.106031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93dd5896-a06d-4149-8a08-88948e274210) Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': '0b81f37d-80e6-429a-9afd-79fccb869bde', 'id': '7ad044e8-196a-4891-bcb2-cd0fa229093d'} Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:35:42.106788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93dd5896-a06d-4149-8a08-88948e274210) Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:35:42.108053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93dd5896-a06d-4149-8a08-88948e274210) Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.109201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93dd5896-a06d-4149-8a08-88948e274210) Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:35:42.110245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93dd5896-a06d-4149-8a08-88948e274210) Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93dd5896-a06d-4149-8a08-88948e274210) Aug 22 19:35:42.111323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.113657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-93dd5896-a06d-4149-8a08-88948e274210) {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:35:42.113657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bad706b2-cd4c-4008-8cee-d4adbc563f88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d" status: 400 len: 269 microversion: 2.1 time: 87.940455 Aug 22 19:35:42.115387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 642/1145] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:34:14 2022] DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d => generated 269 bytes in 87949 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:35:42.121224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dba6db8e-d106-4511-9831-75c34c611e03 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.123472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dba6db8e-d106-4511-9831-75c34c611e03 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.130515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dba6db8e-d106-4511-9831-75c34c611e03 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.131531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dba6db8e-d106-4511-9831-75c34c611e03 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.131975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dba6db8e-d106-4511-9831-75c34c611e03 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.132687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dba6db8e-d106-4511-9831-75c34c611e03 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.133150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dba6db8e-d106-4511-9831-75c34c611e03 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.133568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dba6db8e-d106-4511-9831-75c34c611e03 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.164420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:35:42.169017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dba6db8e-d106-4511-9831-75c34c611e03 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052372 Aug 22 19:35:42.169605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 643/1146] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:35:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:35:42.172187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b0df994-da2d-4aff-ac7e-64c5c94f8168 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.108064 Aug 22 19:35:42.172745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 504/1147] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:35:42 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:35:42.174383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bd78caba-fcb2-4b96-8ce8-8b2b349af050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.176591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bd78caba-fcb2-4b96-8ce8-8b2b349af050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.184388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bd78caba-fcb2-4b96-8ce8-8b2b349af050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.184872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bd78caba-fcb2-4b96-8ce8-8b2b349af050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.185336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bd78caba-fcb2-4b96-8ce8-8b2b349af050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.186032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bd78caba-fcb2-4b96-8ce8-8b2b349af050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.186481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bd78caba-fcb2-4b96-8ce8-8b2b349af050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.186906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bd78caba-fcb2-4b96-8ce8-8b2b349af050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.219991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bd78caba-fcb2-4b96-8ce8-8b2b349af050 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049208 Aug 22 19:35:42.220572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 644/1148] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:35:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:35:42.225315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.225819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.232133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.232620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.233053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.233798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.234245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.234667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.309354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67b2b638-2338-4a4b-bffc-f9ecb08af087 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.311672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67b2b638-2338-4a4b-bffc-f9ecb08af087 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.317999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67b2b638-2338-4a4b-bffc-f9ecb08af087 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.318412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67b2b638-2338-4a4b-bffc-f9ecb08af087 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.318584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'services' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:35:42.319393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67b2b638-2338-4a4b-bffc-f9ecb08af087 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.320136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67b2b638-2338-4a4b-bffc-f9ecb08af087 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.320734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67b2b638-2338-4a4b-bffc-f9ecb08af087 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.321014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67b2b638-2338-4a4b-bffc-f9ecb08af087 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.352049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67b2b638-2338-4a4b-bffc-f9ecb08af087 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178230 Aug 22 19:35:42.352634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 505/1149] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:35:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:35:42.357199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.357685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.363962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.364241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.364670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.365360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.366353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.366771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.376910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5af4de-979a-476b-b72d-495ec325f1b4) Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 HTTP/1.1 Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:35:42.379064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:35:42.380699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5af4de-979a-476b-b72d-495ec325f1b4) Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': 'f6744e43-5389-4422-9030-dfdf1b522dcc', 'id': 'eb79d8da-4f31-4277-89a4-336e11f55658'} Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:35:42.382365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5af4de-979a-476b-b72d-495ec325f1b4) Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:35:42.383738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5af4de-979a-476b-b72d-495ec325f1b4) Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.385148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5af4de-979a-476b-b72d-495ec325f1b4) Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:35:42.386401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5af4de-979a-476b-b72d-495ec325f1b4) Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5af4de-979a-476b-b72d-495ec325f1b4) Aug 22 19:35:42.388907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.390545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f5af4de-979a-476b-b72d-495ec325f1b4) {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:35:42.390545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0098664f-dd1f-4c8a-ae00-c38a80d95a1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 400 len: 269 microversion: 2.1 time: 0.159012 Aug 22 19:35:42.390545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 645/1150] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:35:42 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 269 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:35:42.390545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.391179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.393331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.393813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.394258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.394998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.395447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.395921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.458372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lazy-loading 'services' on Instance uuid 0b81f37d-80e6-429a-9afd-79fccb869bde {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:35:42.470776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:35:42.481291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-71e4f7fc-223c-4118-8357-d386e9d8ee3b tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1226 microversion: 2.1 time: 0.098283 Aug 22 19:35:42.482329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 646/1151] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:35:42 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:35:42.487327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-372cd9b5-b0ad-41c1-8632-01f5e2abaa33 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.490076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-372cd9b5-b0ad-41c1-8632-01f5e2abaa33 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.498640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-372cd9b5-b0ad-41c1-8632-01f5e2abaa33 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.499135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-372cd9b5-b0ad-41c1-8632-01f5e2abaa33 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.499826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-372cd9b5-b0ad-41c1-8632-01f5e2abaa33 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.500632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-372cd9b5-b0ad-41c1-8632-01f5e2abaa33 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.500979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-372cd9b5-b0ad-41c1-8632-01f5e2abaa33 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.501403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-372cd9b5-b0ad-41c1-8632-01f5e2abaa33 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.534214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-372cd9b5-b0ad-41c1-8632-01f5e2abaa33 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050121 Aug 22 19:35:42.534214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 647/1152] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:35:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:35:42.538562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a461152-514a-4ca9-95ec-5cfd4490044a) Aug 22 19:35:42.540729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6dc5b423-40c1-4a3f-bdd3-f772b9b1b2e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Request method failure captured: Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d HTTP/1.1 Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9dlSpq0-pyeFPmh5ASmV5GrMo7tFhVWavh7rWYrq7NWCOVOBV_aIffmUE_yD2yos3RCOrL-zu0c3cZ_HnbNmqCoDxzUAF_LUjcWnD9XRTEMfLMYLrNcSYW6fuRdP06nAjQO7HuzGCFmEho8SlgrWT90nJvB4Mv5BLp4KS2fFbRCUig Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:35:42.541012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}] Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: aa9a0d600b1c42ec8fbb6710744bbd1d Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:35:42.542586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a461152-514a-4ca9-95ec-5cfd4490044a) Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'server_id': '0b81f37d-80e6-429a-9afd-79fccb869bde', 'id': '7ad044e8-196a-4891-bcb2-cd0fa229093d'} Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:35:42.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a461152-514a-4ca9-95ec-5cfd4490044a) Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:35:42.544536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a461152-514a-4ca9-95ec-5cfd4490044a) Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.546847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a461152-514a-4ca9-95ec-5cfd4490044a) Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:35:42.549103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a461152-514a-4ca9-95ec-5cfd4490044a) Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a461152-514a-4ca9-95ec-5cfd4490044a) Aug 22 19:35:42.551387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:35:42.554056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1a461152-514a-4ca9-95ec-5cfd4490044a) {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:35:42.554155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6dc5b423-40c1-4a3f-bdd3-f772b9b1b2e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.554254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fda09a2-7dbf-408d-aabe-737816507e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d" status: 400 len: 269 microversion: 2.1 time: 0.190426 Aug 22 19:35:42.554254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 506/1153] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:35:42 2022] DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d => generated 269 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:35:42.554409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dc5b423-40c1-4a3f-bdd3-f772b9b1b2e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.554409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dc5b423-40c1-4a3f-bdd3-f772b9b1b2e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.554409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dc5b423-40c1-4a3f-bdd3-f772b9b1b2e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.554646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-977122ab-043d-4f56-b9ab-2c184f5f3fcb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.554731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dc5b423-40c1-4a3f-bdd3-f772b9b1b2e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.554731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dc5b423-40c1-4a3f-bdd3-f772b9b1b2e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.554731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dc5b423-40c1-4a3f-bdd3-f772b9b1b2e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.554943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-977122ab-043d-4f56-b9ab-2c184f5f3fcb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.561361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977122ab-043d-4f56-b9ab-2c184f5f3fcb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.561859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977122ab-043d-4f56-b9ab-2c184f5f3fcb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.562300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977122ab-043d-4f56-b9ab-2c184f5f3fcb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.563021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977122ab-043d-4f56-b9ab-2c184f5f3fcb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.563472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977122ab-043d-4f56-b9ab-2c184f5f3fcb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.563953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-977122ab-043d-4f56-b9ab-2c184f5f3fcb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.590327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6dc5b423-40c1-4a3f-bdd3-f772b9b1b2e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055014 Aug 22 19:35:42.591049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 648/1154] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:35:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:35:42.595501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.596026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.598778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-977122ab-043d-4f56-b9ab-2c184f5f3fcb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051922 Aug 22 19:35:42.599438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 507/1155] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:35:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:35:42.603634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.604144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.604667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.604936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:35:42.605272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.605436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:35:42.605721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.606144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.612480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.612988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.613424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:42.614127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:35:42.614580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:35:42.614998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:35:52.600633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=14 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:35:52.609030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:35:52.627468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=46 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:35:52.635502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:36:14.290218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'services' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:36:14.345168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lazy-loading 'services' on Instance uuid 0b81f37d-80e6-429a-9afd-79fccb869bde {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:36:14.377337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66c48d8b-5ee8-4d7c-b5d3-579debc764d6) Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 HTTP/1.1 Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:36:14.379492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:36:14.381061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66c48d8b-5ee8-4d7c-b5d3-579debc764d6) Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': 'f6744e43-5389-4422-9030-dfdf1b522dcc', 'id': 'eb79d8da-4f31-4277-89a4-336e11f55658'} Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:14.382592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66c48d8b-5ee8-4d7c-b5d3-579debc764d6) Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:14.383777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66c48d8b-5ee8-4d7c-b5d3-579debc764d6) Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.384997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66c48d8b-5ee8-4d7c-b5d3-579debc764d6) Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:14.386027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66c48d8b-5ee8-4d7c-b5d3-579debc764d6) Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66c48d8b-5ee8-4d7c-b5d3-579debc764d6) Aug 22 19:36:14.387201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.388610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66c48d8b-5ee8-4d7c-b5d3-579debc764d6) {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:36:14.388610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-06c22981-cd74-4202-9728-6be8e80d4369 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 400 len: 269 microversion: 2.1 time: 31.789224 Aug 22 19:36:14.388610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 649/1156] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:35:42 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 269 bytes in 31790 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:36:14.388610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.389532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.394507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.394997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.395458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.396256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.396817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.397248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.417518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0465beaa-a799-4be3-ba0b-23667c3de0a3) Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Request method failure captured: Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d HTTP/1.1 Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9dlSpq0-pyeFPmh5ASmV5GrMo7tFhVWavh7rWYrq7NWCOVOBV_aIffmUE_yD2yos3RCOrL-zu0c3cZ_HnbNmqCoDxzUAF_LUjcWnD9XRTEMfLMYLrNcSYW6fuRdP06nAjQO7HuzGCFmEho8SlgrWT90nJvB4Mv5BLp4KS2fFbRCUig Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:36:14.419753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}] Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: aa9a0d600b1c42ec8fbb6710744bbd1d Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:36:14.421119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0465beaa-a799-4be3-ba0b-23667c3de0a3) Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'server_id': '0b81f37d-80e6-429a-9afd-79fccb869bde', 'id': '7ad044e8-196a-4891-bcb2-cd0fa229093d'} Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:14.421794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0465beaa-a799-4be3-ba0b-23667c3de0a3) Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:14.423056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0465beaa-a799-4be3-ba0b-23667c3de0a3) Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.424455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0465beaa-a799-4be3-ba0b-23667c3de0a3) Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:14.425631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0465beaa-a799-4be3-ba0b-23667c3de0a3) Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0465beaa-a799-4be3-ba0b-23667c3de0a3) Aug 22 19:36:14.426932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.428238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0465beaa-a799-4be3-ba0b-23667c3de0a3) {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:36:14.428238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26202d8f-6598-4a73-9470-051a29287a4b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d" status: 400 len: 269 microversion: 2.1 time: 31.820811 Aug 22 19:36:14.428238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 508/1157] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:35:42 2022] DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d => generated 269 bytes in 31823 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:36:14.428238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0844e901-74d6-4534-8604-c771c156ca8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.430684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.430864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0844e901-74d6-4534-8604-c771c156ca8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.431235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.431702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.432158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lazy-loading 'fault' on Instance uuid 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:36:14.437156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0844e901-74d6-4534-8604-c771c156ca8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.437671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0844e901-74d6-4534-8604-c771c156ca8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.438115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0844e901-74d6-4534-8604-c771c156ca8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.438807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0844e901-74d6-4534-8604-c771c156ca8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.439311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0844e901-74d6-4534-8604-c771c156ca8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.439710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0844e901-74d6-4534-8604-c771c156ca8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.472553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0844e901-74d6-4534-8604-c771c156ca8f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048119 Aug 22 19:36:14.473383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 509/1158] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:14.476107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:36:14.477827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f5bca63-119c-4918-b41e-fe50892497ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.480017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f5bca63-119c-4918-b41e-fe50892497ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.485019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fdd010ab-3e29-4f49-9a8d-8927b34c22de tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1231 microversion: 2.1 time: 0.101767 Aug 22 19:36:14.485833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 650/1159] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:36:14 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:36:14.489485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5bca63-119c-4918-b41e-fe50892497ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.489974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5bca63-119c-4918-b41e-fe50892497ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.490412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5bca63-119c-4918-b41e-fe50892497ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.490533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f581bc52-f675-4d2f-9768-46dfebcf1793 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.491984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5bca63-119c-4918-b41e-fe50892497ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.492443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5bca63-119c-4918-b41e-fe50892497ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.492875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5bca63-119c-4918-b41e-fe50892497ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.493255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f581bc52-f675-4d2f-9768-46dfebcf1793 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.499259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f581bc52-f675-4d2f-9768-46dfebcf1793 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.499895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f581bc52-f675-4d2f-9768-46dfebcf1793 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.500222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f581bc52-f675-4d2f-9768-46dfebcf1793 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.500940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f581bc52-f675-4d2f-9768-46dfebcf1793 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.501385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f581bc52-f675-4d2f-9768-46dfebcf1793 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.501805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f581bc52-f675-4d2f-9768-46dfebcf1793 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.522590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f5bca63-119c-4918-b41e-fe50892497ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048349 Aug 22 19:36:14.523240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 510/1160] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:14.528030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.528526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.532827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f581bc52-f675-4d2f-9768-46dfebcf1793 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Aug 22 19:36:14.533406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 651/1161] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:14.534854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.535365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.535841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.536582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.537038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.537463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.538019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.538587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.544500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.544981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.545412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.546110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.546554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.546970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.621328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'services' on Instance uuid f6744e43-5389-4422-9030-dfdf1b522dcc {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:36:14.670293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lazy-loading 'services' on Instance uuid 0b81f37d-80e6-429a-9afd-79fccb869bde {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:36:14.704617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59748057-6ec6-4a11-aca6-80f290b5b21e) Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 HTTP/1.1 Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:36:14.706818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 19:36:14.708206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59748057-6ec6-4a11-aca6-80f290b5b21e) Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'server_id': 'f6744e43-5389-4422-9030-dfdf1b522dcc', 'id': 'eb79d8da-4f31-4277-89a4-336e11f55658'} Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:14.709106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59748057-6ec6-4a11-aca6-80f290b5b21e) Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:14.712294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59748057-6ec6-4a11-aca6-80f290b5b21e) Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.713769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59748057-6ec6-4a11-aca6-80f290b5b21e) Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:14.714869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59748057-6ec6-4a11-aca6-80f290b5b21e) Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59748057-6ec6-4a11-aca6-80f290b5b21e) Aug 22 19:36:14.717016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.719880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59748057-6ec6-4a11-aca6-80f290b5b21e) {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:36:14.719880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab8f875e-d469-42cf-897d-199ec24634f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658" status: 400 len: 269 microversion: 2.1 time: 0.184125 Aug 22 19:36:14.719880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 511/1162] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:36:14 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments/eb79d8da-4f31-4277-89a4-336e11f55658 => generated 269 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:36:14.719880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.720556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.728009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.728655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.730288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.731544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.732143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.732582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.750370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46ee83de-9c68-479a-bb69-b7bd1af9a2d9) Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Request method failure captured: Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d HTTP/1.1 Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9dlSpq0-pyeFPmh5ASmV5GrMo7tFhVWavh7rWYrq7NWCOVOBV_aIffmUE_yD2yos3RCOrL-zu0c3cZ_HnbNmqCoDxzUAF_LUjcWnD9XRTEMfLMYLrNcSYW6fuRdP06nAjQO7HuzGCFmEho8SlgrWT90nJvB4Mv5BLp4KS2fFbRCUig Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:36:14.752600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/44cc7501b8ad41cc93825b4480d7c3df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/44cc7501b8ad41cc93825b4480d7c3df"}]}] Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 44cc7501b8ad41cc93825b4480d7c3df Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-226397738 Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: aa9a0d600b1c42ec8fbb6710744bbd1d Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesSnapshotTestJSON-226397738-project Aug 22 19:36:14.754217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46ee83de-9c68-479a-bb69-b7bd1af9a2d9) Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': '0b81f37d-80e6-429a-9afd-79fccb869bde', 'id': '7ad044e8-196a-4891-bcb2-cd0fa229093d'} Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:14.754895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46ee83de-9c68-479a-bb69-b7bd1af9a2d9) Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:14.756043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46ee83de-9c68-479a-bb69-b7bd1af9a2d9) Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.757873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46ee83de-9c68-479a-bb69-b7bd1af9a2d9) Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:14.758895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46ee83de-9c68-479a-bb69-b7bd1af9a2d9) Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46ee83de-9c68-479a-bb69-b7bd1af9a2d9) Aug 22 19:36:14.760004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:14.761030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-46ee83de-9c68-479a-bb69-b7bd1af9a2d9) {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:36:14.761030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-614531b0-f6f6-4aee-bc79-cea97c09064a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d" status: 400 len: 269 microversion: 2.1 time: 0.219656 Aug 22 19:36:14.761030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 652/1163] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:36:14 2022] DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde/os-volume_attachments/7ad044e8-196a-4891-bcb2-cd0fa229093d => generated 269 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:36:14.764212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9dbb7e49-2133-4f27-96f6-587b24d5cb30 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.767095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9dbb7e49-2133-4f27-96f6-587b24d5cb30 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.772884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.773668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.774241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.774833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lazy-loading 'fault' on Instance uuid 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:36:14.777870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dbb7e49-2133-4f27-96f6-587b24d5cb30 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.778370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dbb7e49-2133-4f27-96f6-587b24d5cb30 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.778804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dbb7e49-2133-4f27-96f6-587b24d5cb30 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.780056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dbb7e49-2133-4f27-96f6-587b24d5cb30 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.780679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dbb7e49-2133-4f27-96f6-587b24d5cb30 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.781397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9dbb7e49-2133-4f27-96f6-587b24d5cb30 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.826716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9dbb7e49-2133-4f27-96f6-587b24d5cb30 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070576 Aug 22 19:36:14.827182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3705aa22743c49e3ac2f37c7f2084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3adbe4feef048239c2020ac458e11b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:36:14.832022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 653/1164] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:14.834982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2eef742-613b-4341-914d-257d9769890d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 200 len: 1185 microversion: 2.1 time: 0.124934 Aug 22 19:36:14.835367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0da24866-e015-4b74-a1fb-bdf194d0064d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.837633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0da24866-e015-4b74-a1fb-bdf194d0064d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.845182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 512/1165] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:36:14 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 1185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:36:14.846428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da24866-e015-4b74-a1fb-bdf194d0064d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.847103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da24866-e015-4b74-a1fb-bdf194d0064d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.847608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da24866-e015-4b74-a1fb-bdf194d0064d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.848599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da24866-e015-4b74-a1fb-bdf194d0064d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.849171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da24866-e015-4b74-a1fb-bdf194d0064d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.849668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da24866-e015-4b74-a1fb-bdf194d0064d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.853494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c355e5a1-4995-433c-84cf-74cb99c8d123 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.856916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c355e5a1-4995-433c-84cf-74cb99c8d123 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.863382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c355e5a1-4995-433c-84cf-74cb99c8d123 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.863906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c355e5a1-4995-433c-84cf-74cb99c8d123 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.864346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c355e5a1-4995-433c-84cf-74cb99c8d123 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.865058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c355e5a1-4995-433c-84cf-74cb99c8d123 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.865679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c355e5a1-4995-433c-84cf-74cb99c8d123 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.866144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c355e5a1-4995-433c-84cf-74cb99c8d123 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.885176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0da24866-e015-4b74-a1fb-bdf194d0064d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056205 Aug 22 19:36:14.886011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 654/1166] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:14.891319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a56230f3-9274-4366-b136-96d76e056515 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:14.893837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a56230f3-9274-4366-b136-96d76e056515 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:14.900209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56230f3-9274-4366-b136-96d76e056515 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.900606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56230f3-9274-4366-b136-96d76e056515 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.901036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56230f3-9274-4366-b136-96d76e056515 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.901218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c355e5a1-4995-433c-84cf-74cb99c8d123 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054474 Aug 22 19:36:14.901878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56230f3-9274-4366-b136-96d76e056515 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:14.902006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 513/1167] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:14.904164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56230f3-9274-4366-b136-96d76e056515 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:14.904705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56230f3-9274-4366-b136-96d76e056515 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:14.937201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a56230f3-9274-4366-b136-96d76e056515 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049855 Aug 22 19:36:14.938159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 655/1168] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:15.331125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:15.331618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:15.338816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.339297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.339755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:15.340446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.340897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.341312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:15.357668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] HTTP exception thrown: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Request method failure captured: Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 HTTP/1.1 Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9ckF4iJfF9HbrQH8qg_iS8QVUY2wDB1yEUO8jQWPiqG5WiV-EIjidMEnFzK4qqLl9fdZ5DyPQ5qFr6m1l_H7jF46B0E6sz97PwWRVNDjWP0RiT4rhbYYxQ_dYWeZqrzx8tJZbyvh4Z1E87n1t5O3GvkyxzjbvUek8c8xvycJo76sc8 Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: e3adbe4feef048239c2020ac458e11b0 Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-899342940 Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:36:15.359238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e3adbe4feef048239c2020ac458e11b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e3adbe4feef048239c2020ac458e11b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e3adbe4feef048239c2020ac458e11b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e3adbe4feef048239c2020ac458e11b0"}]}] Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-899342940 Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: e3adbe4feef048239c2020ac458e11b0 Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-899342940 Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-899342940-project Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: a1b3705aa22743c49e3ac2f37c7f2084 Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-899342940-project Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.360847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '3e3f25ff-3b82-4e99-8f50-4b422b2f7b59'} Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:36:15.362066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.363518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.365114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Returning 404 to user: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:36:15.365114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4b24b68-e0c3-456d-9fc9-639b40e79060 tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 404 len: 111 microversion: 2.1 time: 0.033416 Aug 22 19:36:15.365114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 514/1169] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:36:15 2022] DELETE /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:36:15.369464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:15.370116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] [instance: 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:15.376277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.376766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.377208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:15.377913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.378371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.378796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:15.393562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] HTTP exception thrown: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Request method failure captured: Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 HTTP/1.1 Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9ckF4iJfF9HbrQH8qg_iS8QVUY2wDB1yEUO8jQWPiqG5WiV-EIjidMEnFzK4qqLl9fdZ5DyPQ5qFr6m1l_H7jF46B0E6sz97PwWRVNDjWP0RiT4rhbYYxQ_dYWeZqrzx8tJZbyvh4Z1E87n1t5O3GvkyxzjbvUek8c8xvycJo76sc8 Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: e3adbe4feef048239c2020ac458e11b0 Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-TestVolumeBootPattern-899342940 Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:36:15.395103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e3adbe4feef048239c2020ac458e11b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e3adbe4feef048239c2020ac458e11b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e3adbe4feef048239c2020ac458e11b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e3adbe4feef048239c2020ac458e11b0"}]}] Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-TestVolumeBootPattern-899342940 Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: e3adbe4feef048239c2020ac458e11b0 Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-TestVolumeBootPattern-899342940 Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-TestVolumeBootPattern-899342940-project Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: a1b3705aa22743c49e3ac2f37c7f2084 Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-TestVolumeBootPattern-899342940-project Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.397073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '3e3f25ff-3b82-4e99-8f50-4b422b2f7b59'} Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:36:15.398670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. Aug 22 19:36:15.400269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:15.401785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Returning 404 to user: Instance 3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:36:15.401785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-911f6259-fe36-4d53-a7f5-b6da8574543d tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59" status: 404 len: 111 microversion: 2.1 time: 0.031008 Aug 22 19:36:15.401785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 656/1170] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:36:15 2022] GET /compute/v2.1/servers/3e3f25ff-3b82-4e99-8f50-4b422b2f7b59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:36:15.840277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aafbfdf5-ba09-49f0-acbc-e487ac2b1f8c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:36:15.842468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aafbfdf5-ba09-49f0-acbc-e487ac2b1f8c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:15.848720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aafbfdf5-ba09-49f0-acbc-e487ac2b1f8c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.849210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aafbfdf5-ba09-49f0-acbc-e487ac2b1f8c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.849648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aafbfdf5-ba09-49f0-acbc-e487ac2b1f8c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:15.850352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aafbfdf5-ba09-49f0-acbc-e487ac2b1f8c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.850807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aafbfdf5-ba09-49f0-acbc-e487ac2b1f8c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.851213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aafbfdf5-ba09-49f0-acbc-e487ac2b1f8c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:15.898659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7424f49f-9109-4a17-a5b2-eb89c0f8a96b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:36:15.900951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7424f49f-9109-4a17-a5b2-eb89c0f8a96b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:15.907004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7424f49f-9109-4a17-a5b2-eb89c0f8a96b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.907620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7424f49f-9109-4a17-a5b2-eb89c0f8a96b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.908158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7424f49f-9109-4a17-a5b2-eb89c0f8a96b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:15.908926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7424f49f-9109-4a17-a5b2-eb89c0f8a96b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.909449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7424f49f-9109-4a17-a5b2-eb89c0f8a96b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.909874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7424f49f-9109-4a17-a5b2-eb89c0f8a96b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:15.957245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aafbfdf5-ba09-49f0-acbc-e487ac2b1f8c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/action" status: 200 len: 41741 microversion: 2.1 time: 0.121580 Aug 22 19:36:15.963687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 515/1171] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:36:15 2022] POST /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e/action => generated 41741 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:36:15.963687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5ed7a979-1a00-4455-ab03-f57058fd60fa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:15.965930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ed7a979-1a00-4455-ab03-f57058fd60fa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:15.975346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ed7a979-1a00-4455-ab03-f57058fd60fa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.975869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ed7a979-1a00-4455-ab03-f57058fd60fa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.976303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ed7a979-1a00-4455-ab03-f57058fd60fa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:15.977008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ed7a979-1a00-4455-ab03-f57058fd60fa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:15.977457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ed7a979-1a00-4455-ab03-f57058fd60fa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:15.977875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ed7a979-1a00-4455-ab03-f57058fd60fa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:16.011111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5ed7a979-1a00-4455-ab03-f57058fd60fa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051854 Aug 22 19:36:16.011685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 516/1172] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:16.016657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11026462-67b1-4329-97a4-4b6fcb31c88a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:16.018712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-11026462-67b1-4329-97a4-4b6fcb31c88a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:16.025153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11026462-67b1-4329-97a4-4b6fcb31c88a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:16.025632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11026462-67b1-4329-97a4-4b6fcb31c88a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:16.026060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11026462-67b1-4329-97a4-4b6fcb31c88a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:16.026765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11026462-67b1-4329-97a4-4b6fcb31c88a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:16.027207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11026462-67b1-4329-97a4-4b6fcb31c88a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:16.027625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11026462-67b1-4329-97a4-4b6fcb31c88a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:16.048064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7424f49f-9109-4a17-a5b2-eb89c0f8a96b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/action" status: 200 len: 82624 microversion: 2.1 time: 0.153527 Aug 22 19:36:16.048849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 657/1173] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:36:15 2022] POST /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/action => generated 82624 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 19:36:16.060224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11026462-67b1-4329-97a4-4b6fcb31c88a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Aug 22 19:36:16.060804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 517/1174] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:16.064191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:16.064796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:16.072541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:16.073026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:16.073459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:16.074159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:16.074607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:16.075028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:16.160168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lazy-loading 'services' on Instance uuid 9698a0b1-a98a-40e1-9093-39946273a155 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:36:16.216274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d0cb38c-ed85-4851-8f6d-1760d2ed8ca0) Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Request method failure captured: Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments/c73d1d5d-05f9-45c4-88b0-334566c488e3 HTTP/1.1 Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9eO0l4QAhUjC0GafXqenEFnXs1TNFCQ-uXTwDLlsbGl5qwmU0f8UGUEHHoWVvAvnL5kxHQF-mq4jGBfgVkHjKldf_bi7RPPbtOWzD1UC5EKgrEd1rPil8RJLCA3_beGDMI5BztX5W6Adaacfzc4FZ5xxxDsBeLmx3Imk7FyisUv7JY Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: ec13a665e661424fa8602f7fbd962e16 Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-TestMinimumBasicScenario-1618333595 Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:36:16.218691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ec13a665e661424fa8602f7fbd962e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec13a665e661424fa8602f7fbd962e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ec13a665e661424fa8602f7fbd962e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ec13a665e661424fa8602f7fbd962e16"}]}] Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-TestMinimumBasicScenario-1618333595 Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: ec13a665e661424fa8602f7fbd962e16 Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1618333595 Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-TestMinimumBasicScenario-1618333595-project Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: cea80d48ea4a467d96ca9dfe2671bdd7 Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-TestMinimumBasicScenario-1618333595-project Aug 22 19:36:16.220318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d0cb38c-ed85-4851-8f6d-1760d2ed8ca0) Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'server_id': '9698a0b1-a98a-40e1-9093-39946273a155', 'id': 'c73d1d5d-05f9-45c4-88b0-334566c488e3'} Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:16.221114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d0cb38c-ed85-4851-8f6d-1760d2ed8ca0) Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:36:16.222583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d0cb38c-ed85-4851-8f6d-1760d2ed8ca0) Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:16.224020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d0cb38c-ed85-4851-8f6d-1760d2ed8ca0) Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:16.225659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d0cb38c-ed85-4851-8f6d-1760d2ed8ca0) Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d0cb38c-ed85-4851-8f6d-1760d2ed8ca0) Aug 22 19:36:16.227919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:36:16.229322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1d0cb38c-ed85-4851-8f6d-1760d2ed8ca0) {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:36:16.229322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3203e192-4c35-462a-a295-f7500d1b7527 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments/c73d1d5d-05f9-45c4-88b0-334566c488e3" status: 400 len: 269 microversion: 2.1 time: 0.160392 Aug 22 19:36:16.229322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 658/1175] 10.222.0.61 () {58 vars in 1416 bytes} [Mon Aug 22 19:36:16 2022] DELETE /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155/os-volume_attachments/c73d1d5d-05f9-45c4-88b0-334566c488e3 => generated 269 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 22 19:36:17.023720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d0f7ce0-423f-4dde-a79a-75b752e7a3ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:17.025894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5d0f7ce0-423f-4dde-a79a-75b752e7a3ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:17.032576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d0f7ce0-423f-4dde-a79a-75b752e7a3ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:17.033069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d0f7ce0-423f-4dde-a79a-75b752e7a3ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:17.033506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d0f7ce0-423f-4dde-a79a-75b752e7a3ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:17.034244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d0f7ce0-423f-4dde-a79a-75b752e7a3ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:17.034735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d0f7ce0-423f-4dde-a79a-75b752e7a3ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:17.035066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d0f7ce0-423f-4dde-a79a-75b752e7a3ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:17.066225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5d0f7ce0-423f-4dde-a79a-75b752e7a3ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 Aug 22 19:36:17.066996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 518/1176] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:17 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:17.073898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e2f45a94-067e-44ad-9e29-074e2bbb7135 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:17.076129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e2f45a94-067e-44ad-9e29-074e2bbb7135 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:17.083043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f45a94-067e-44ad-9e29-074e2bbb7135 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:17.083529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f45a94-067e-44ad-9e29-074e2bbb7135 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:17.084012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f45a94-067e-44ad-9e29-074e2bbb7135 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:17.084722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f45a94-067e-44ad-9e29-074e2bbb7135 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:17.085799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f45a94-067e-44ad-9e29-074e2bbb7135 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:17.088919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f45a94-067e-44ad-9e29-074e2bbb7135 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:17.116498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e2f45a94-067e-44ad-9e29-074e2bbb7135 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Aug 22 19:36:17.117078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 659/1177] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:36:18.078580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2da497b0-591a-4173-8816-79e7e37d8c7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:18.080760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2da497b0-591a-4173-8816-79e7e37d8c7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:18.089513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2da497b0-591a-4173-8816-79e7e37d8c7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:18.089995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2da497b0-591a-4173-8816-79e7e37d8c7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:18.090423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2da497b0-591a-4173-8816-79e7e37d8c7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:18.091213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2da497b0-591a-4173-8816-79e7e37d8c7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:18.091708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2da497b0-591a-4173-8816-79e7e37d8c7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:18.092103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2da497b0-591a-4173-8816-79e7e37d8c7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:18.130254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2da497b0-591a-4173-8816-79e7e37d8c7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055293 Aug 22 19:36:18.135594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 519/1178] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:18 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:18.135915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5f94d60f-3865-40aa-a4f4-066fb322b0e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:18.137171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5f94d60f-3865-40aa-a4f4-066fb322b0e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:18.146487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f94d60f-3865-40aa-a4f4-066fb322b0e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:18.147333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f94d60f-3865-40aa-a4f4-066fb322b0e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:18.148139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f94d60f-3865-40aa-a4f4-066fb322b0e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:18.149762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f94d60f-3865-40aa-a4f4-066fb322b0e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:18.150595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f94d60f-3865-40aa-a4f4-066fb322b0e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:18.151366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f94d60f-3865-40aa-a4f4-066fb322b0e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:18.191504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5f94d60f-3865-40aa-a4f4-066fb322b0e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065997 Aug 22 19:36:18.192106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 660/1179] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:19.145349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75e47ecc-9246-44cd-90fe-d31a21585e3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:19.147499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75e47ecc-9246-44cd-90fe-d31a21585e3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:19.154066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e47ecc-9246-44cd-90fe-d31a21585e3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:19.154553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e47ecc-9246-44cd-90fe-d31a21585e3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:19.154999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e47ecc-9246-44cd-90fe-d31a21585e3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:19.155727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e47ecc-9246-44cd-90fe-d31a21585e3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:19.156181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e47ecc-9246-44cd-90fe-d31a21585e3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:19.156601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75e47ecc-9246-44cd-90fe-d31a21585e3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:19.187544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75e47ecc-9246-44cd-90fe-d31a21585e3e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046103 Aug 22 19:36:19.188189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 520/1180] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:19.203924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4311a93c-6f38-4042-99e6-b9249b245d33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:19.206365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4311a93c-6f38-4042-99e6-b9249b245d33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:19.213290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4311a93c-6f38-4042-99e6-b9249b245d33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:19.213785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4311a93c-6f38-4042-99e6-b9249b245d33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:19.214376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4311a93c-6f38-4042-99e6-b9249b245d33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:19.215079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4311a93c-6f38-4042-99e6-b9249b245d33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:19.215537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4311a93c-6f38-4042-99e6-b9249b245d33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:19.216040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4311a93c-6f38-4042-99e6-b9249b245d33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:19.247168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4311a93c-6f38-4042-99e6-b9249b245d33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047329 Aug 22 19:36:19.247764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 661/1181] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:20.200433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc6f2372-2c14-41e4-b5d4-ef03dd5a0ca7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:20.202558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc6f2372-2c14-41e4-b5d4-ef03dd5a0ca7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:20.209182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc6f2372-2c14-41e4-b5d4-ef03dd5a0ca7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:20.209674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc6f2372-2c14-41e4-b5d4-ef03dd5a0ca7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:20.210759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc6f2372-2c14-41e4-b5d4-ef03dd5a0ca7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:20.211464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc6f2372-2c14-41e4-b5d4-ef03dd5a0ca7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:20.211951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc6f2372-2c14-41e4-b5d4-ef03dd5a0ca7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:20.212378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc6f2372-2c14-41e4-b5d4-ef03dd5a0ca7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:20.242764 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc6f2372-2c14-41e4-b5d4-ef03dd5a0ca7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 Aug 22 19:36:20.243490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 521/1182] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:20 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:20.259797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ad38963e-543d-4326-adb7-054633f6a1cb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:20.262379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ad38963e-543d-4326-adb7-054633f6a1cb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:20.268953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad38963e-543d-4326-adb7-054633f6a1cb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:20.269441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad38963e-543d-4326-adb7-054633f6a1cb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:20.269879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad38963e-543d-4326-adb7-054633f6a1cb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:20.270587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad38963e-543d-4326-adb7-054633f6a1cb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:20.271040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad38963e-543d-4326-adb7-054633f6a1cb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:20.271470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad38963e-543d-4326-adb7-054633f6a1cb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:20.302122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ad38963e-543d-4326-adb7-054633f6a1cb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047539 Aug 22 19:36:20.302771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 662/1183] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:21.255094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce543009-76da-48e4-8eb5-f9446e01f418 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:21.257919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce543009-76da-48e4-8eb5-f9446e01f418 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:21.264391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce543009-76da-48e4-8eb5-f9446e01f418 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:21.264927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce543009-76da-48e4-8eb5-f9446e01f418 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:21.265404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce543009-76da-48e4-8eb5-f9446e01f418 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:21.266214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce543009-76da-48e4-8eb5-f9446e01f418 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:21.266717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce543009-76da-48e4-8eb5-f9446e01f418 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:21.267184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce543009-76da-48e4-8eb5-f9446e01f418 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:21.298168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce543009-76da-48e4-8eb5-f9446e01f418 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Aug 22 19:36:21.298954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 522/1184] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:21 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:36:21.314343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e560cdfd-23c4-4cb2-bc61-cbd264f37fbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:21.316530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e560cdfd-23c4-4cb2-bc61-cbd264f37fbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:21.323506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e560cdfd-23c4-4cb2-bc61-cbd264f37fbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:21.324061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e560cdfd-23c4-4cb2-bc61-cbd264f37fbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:21.324498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e560cdfd-23c4-4cb2-bc61-cbd264f37fbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:21.325209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e560cdfd-23c4-4cb2-bc61-cbd264f37fbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:21.325660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e560cdfd-23c4-4cb2-bc61-cbd264f37fbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:21.326083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e560cdfd-23c4-4cb2-bc61-cbd264f37fbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:21.355541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e560cdfd-23c4-4cb2-bc61-cbd264f37fbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Aug 22 19:36:21.356140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 663/1185] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:22.310391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb09d9d6-a7fa-470b-8921-18b3300b8895 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:22.312726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb09d9d6-a7fa-470b-8921-18b3300b8895 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:22.319890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb09d9d6-a7fa-470b-8921-18b3300b8895 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:22.320374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb09d9d6-a7fa-470b-8921-18b3300b8895 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:22.320809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb09d9d6-a7fa-470b-8921-18b3300b8895 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:22.321540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb09d9d6-a7fa-470b-8921-18b3300b8895 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:22.321992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb09d9d6-a7fa-470b-8921-18b3300b8895 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:22.322415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb09d9d6-a7fa-470b-8921-18b3300b8895 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:22.353044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb09d9d6-a7fa-470b-8921-18b3300b8895 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 Aug 22 19:36:22.353591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 523/1186] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:22 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:22.367906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4d1f2399-9adf-4ff4-947d-5f3e1a765141 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:22.370133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4d1f2399-9adf-4ff4-947d-5f3e1a765141 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:22.376636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d1f2399-9adf-4ff4-947d-5f3e1a765141 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:22.377115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d1f2399-9adf-4ff4-947d-5f3e1a765141 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:22.377544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d1f2399-9adf-4ff4-947d-5f3e1a765141 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:22.378268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d1f2399-9adf-4ff4-947d-5f3e1a765141 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:22.378713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d1f2399-9adf-4ff4-947d-5f3e1a765141 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:22.379131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d1f2399-9adf-4ff4-947d-5f3e1a765141 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:22.417622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4d1f2399-9adf-4ff4-947d-5f3e1a765141 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053736 Aug 22 19:36:22.418106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 664/1187] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:23.365496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d7f15d1-56d9-478b-b90b-42bf10e8f29d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:23.367675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d7f15d1-56d9-478b-b90b-42bf10e8f29d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:23.374149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d7f15d1-56d9-478b-b90b-42bf10e8f29d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:23.374627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d7f15d1-56d9-478b-b90b-42bf10e8f29d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:23.375063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d7f15d1-56d9-478b-b90b-42bf10e8f29d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:23.375803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d7f15d1-56d9-478b-b90b-42bf10e8f29d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:23.376245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d7f15d1-56d9-478b-b90b-42bf10e8f29d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:23.376668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d7f15d1-56d9-478b-b90b-42bf10e8f29d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:23.407729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d7f15d1-56d9-478b-b90b-42bf10e8f29d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045993 Aug 22 19:36:23.408281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 524/1188] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:23 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:23.430225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d973067d-35cd-4867-b3e0-2d644fd27088 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:23.432456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d973067d-35cd-4867-b3e0-2d644fd27088 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:23.440793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d973067d-35cd-4867-b3e0-2d644fd27088 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:23.441842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d973067d-35cd-4867-b3e0-2d644fd27088 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:23.442705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d973067d-35cd-4867-b3e0-2d644fd27088 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:23.445607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d973067d-35cd-4867-b3e0-2d644fd27088 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:23.446806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d973067d-35cd-4867-b3e0-2d644fd27088 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:23.447810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d973067d-35cd-4867-b3e0-2d644fd27088 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:23.485217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:36:23.490884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d973067d-35cd-4867-b3e0-2d644fd27088 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065280 Aug 22 19:36:23.491443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 665/1189] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:24.419608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b2626948-7f78-4d61-bf29-08ff125b4745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:24.421791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b2626948-7f78-4d61-bf29-08ff125b4745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:24.428852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2626948-7f78-4d61-bf29-08ff125b4745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:24.429348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2626948-7f78-4d61-bf29-08ff125b4745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:24.429783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2626948-7f78-4d61-bf29-08ff125b4745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:24.430480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2626948-7f78-4d61-bf29-08ff125b4745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:24.430934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2626948-7f78-4d61-bf29-08ff125b4745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:24.431355 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2626948-7f78-4d61-bf29-08ff125b4745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:24.435407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:36:24.462495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b2626948-7f78-4d61-bf29-08ff125b4745 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046847 Aug 22 19:36:24.463386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 525/1190] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:24.502999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-94dcbee5-86d2-463a-8f1e-b6836d28d41c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:24.505157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-94dcbee5-86d2-463a-8f1e-b6836d28d41c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:24.512401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94dcbee5-86d2-463a-8f1e-b6836d28d41c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:24.512882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94dcbee5-86d2-463a-8f1e-b6836d28d41c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:24.513315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94dcbee5-86d2-463a-8f1e-b6836d28d41c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:24.514090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94dcbee5-86d2-463a-8f1e-b6836d28d41c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:24.514449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94dcbee5-86d2-463a-8f1e-b6836d28d41c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:24.514868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94dcbee5-86d2-463a-8f1e-b6836d28d41c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:24.546099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-94dcbee5-86d2-463a-8f1e-b6836d28d41c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046958 Aug 22 19:36:24.546708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 666/1191] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:25.474791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ae0af5d-7b5d-4f7a-8a6c-681595c8b942 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:25.476967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ae0af5d-7b5d-4f7a-8a6c-681595c8b942 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:25.483530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ae0af5d-7b5d-4f7a-8a6c-681595c8b942 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:25.484048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ae0af5d-7b5d-4f7a-8a6c-681595c8b942 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:25.484480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ae0af5d-7b5d-4f7a-8a6c-681595c8b942 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:25.485183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ae0af5d-7b5d-4f7a-8a6c-681595c8b942 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:25.485636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ae0af5d-7b5d-4f7a-8a6c-681595c8b942 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:25.486056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ae0af5d-7b5d-4f7a-8a6c-681595c8b942 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:25.519686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ae0af5d-7b5d-4f7a-8a6c-681595c8b942 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048684 Aug 22 19:36:25.520255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 526/1192] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:25 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:25.558282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0e7e5d97-77cb-4af7-ac55-7c2f10f26c41 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:25.560580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0e7e5d97-77cb-4af7-ac55-7c2f10f26c41 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:25.567357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e7e5d97-77cb-4af7-ac55-7c2f10f26c41 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:25.567812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e7e5d97-77cb-4af7-ac55-7c2f10f26c41 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:25.568253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e7e5d97-77cb-4af7-ac55-7c2f10f26c41 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:25.569468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e7e5d97-77cb-4af7-ac55-7c2f10f26c41 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:25.570102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e7e5d97-77cb-4af7-ac55-7c2f10f26c41 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:25.570532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e7e5d97-77cb-4af7-ac55-7c2f10f26c41 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:25.602397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0e7e5d97-77cb-4af7-ac55-7c2f10f26c41 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048003 Aug 22 19:36:25.602996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 667/1193] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:36:26.532664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38e4ae10-d8f3-4232-a744-9c9a11b4abb4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:26.534814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38e4ae10-d8f3-4232-a744-9c9a11b4abb4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:26.542006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e4ae10-d8f3-4232-a744-9c9a11b4abb4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:26.542485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e4ae10-d8f3-4232-a744-9c9a11b4abb4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:26.542918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e4ae10-d8f3-4232-a744-9c9a11b4abb4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:26.543618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e4ae10-d8f3-4232-a744-9c9a11b4abb4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:26.544095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e4ae10-d8f3-4232-a744-9c9a11b4abb4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:26.544519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e4ae10-d8f3-4232-a744-9c9a11b4abb4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:26.574850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38e4ae10-d8f3-4232-a744-9c9a11b4abb4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046103 Aug 22 19:36:26.575411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 527/1194] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:26 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:26.614576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c21033fc-85a6-44b5-94a5-af25e49778c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:26.616791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c21033fc-85a6-44b5-94a5-af25e49778c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:26.623269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c21033fc-85a6-44b5-94a5-af25e49778c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:26.623793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c21033fc-85a6-44b5-94a5-af25e49778c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:26.624233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c21033fc-85a6-44b5-94a5-af25e49778c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:26.624939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c21033fc-85a6-44b5-94a5-af25e49778c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:26.625392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c21033fc-85a6-44b5-94a5-af25e49778c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:26.625816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c21033fc-85a6-44b5-94a5-af25e49778c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:26.657446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c21033fc-85a6-44b5-94a5-af25e49778c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Aug 22 19:36:26.657755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 668/1195] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:27.587623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f64fb68c-fa36-44f9-aeeb-f1ccd977c339 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:27.590027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f64fb68c-fa36-44f9-aeeb-f1ccd977c339 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:27.596445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f64fb68c-fa36-44f9-aeeb-f1ccd977c339 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:27.596926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f64fb68c-fa36-44f9-aeeb-f1ccd977c339 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:27.597359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f64fb68c-fa36-44f9-aeeb-f1ccd977c339 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:27.598055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f64fb68c-fa36-44f9-aeeb-f1ccd977c339 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:27.598501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f64fb68c-fa36-44f9-aeeb-f1ccd977c339 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:27.598919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f64fb68c-fa36-44f9-aeeb-f1ccd977c339 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:27.629791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f64fb68c-fa36-44f9-aeeb-f1ccd977c339 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046570 Aug 22 19:36:27.630367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 528/1196] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:27.669591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-256ec4aa-5a97-46a6-a4eb-16601537662e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:27.671810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-256ec4aa-5a97-46a6-a4eb-16601537662e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:27.678407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-256ec4aa-5a97-46a6-a4eb-16601537662e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:27.678892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-256ec4aa-5a97-46a6-a4eb-16601537662e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:27.679326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-256ec4aa-5a97-46a6-a4eb-16601537662e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:27.680049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-256ec4aa-5a97-46a6-a4eb-16601537662e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:27.680504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-256ec4aa-5a97-46a6-a4eb-16601537662e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:27.680996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-256ec4aa-5a97-46a6-a4eb-16601537662e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:27.713112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-256ec4aa-5a97-46a6-a4eb-16601537662e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047143 Aug 22 19:36:27.713894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 669/1197] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:27 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:28.642568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cd81c82-2d6d-48fa-81fc-32d8af5f6c29 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:28.644745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cd81c82-2d6d-48fa-81fc-32d8af5f6c29 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:28.651190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cd81c82-2d6d-48fa-81fc-32d8af5f6c29 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:28.651694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cd81c82-2d6d-48fa-81fc-32d8af5f6c29 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:28.652127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cd81c82-2d6d-48fa-81fc-32d8af5f6c29 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:28.652820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cd81c82-2d6d-48fa-81fc-32d8af5f6c29 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:28.653278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cd81c82-2d6d-48fa-81fc-32d8af5f6c29 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:28.653693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cd81c82-2d6d-48fa-81fc-32d8af5f6c29 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:28.684293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cd81c82-2d6d-48fa-81fc-32d8af5f6c29 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045586 Aug 22 19:36:28.684855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 529/1198] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:28 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:28.726444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-18dbfce0-aed2-42c6-901e-712a03f97df5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:28.728669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-18dbfce0-aed2-42c6-901e-712a03f97df5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:28.735294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18dbfce0-aed2-42c6-901e-712a03f97df5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:28.735823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18dbfce0-aed2-42c6-901e-712a03f97df5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:28.736256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18dbfce0-aed2-42c6-901e-712a03f97df5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:28.736955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18dbfce0-aed2-42c6-901e-712a03f97df5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:28.737405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18dbfce0-aed2-42c6-901e-712a03f97df5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:28.737827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18dbfce0-aed2-42c6-901e-712a03f97df5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:28.768260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-18dbfce0-aed2-42c6-901e-712a03f97df5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Aug 22 19:36:28.768831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 670/1199] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:29.696311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-739239c0-419d-40e5-9e2e-b937675d7107 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:29.700495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-739239c0-419d-40e5-9e2e-b937675d7107 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:29.705213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-739239c0-419d-40e5-9e2e-b937675d7107 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:29.705700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-739239c0-419d-40e5-9e2e-b937675d7107 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:29.706134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-739239c0-419d-40e5-9e2e-b937675d7107 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:29.706839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-739239c0-419d-40e5-9e2e-b937675d7107 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:29.707290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-739239c0-419d-40e5-9e2e-b937675d7107 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:29.707748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-739239c0-419d-40e5-9e2e-b937675d7107 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:29.738558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-739239c0-419d-40e5-9e2e-b937675d7107 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046684 Aug 22 19:36:29.739118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 530/1200] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:29 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:29.781466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4a77797b-8d5c-4212-b4f6-b67fd49a0728 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:29.783565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4a77797b-8d5c-4212-b4f6-b67fd49a0728 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:29.790394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a77797b-8d5c-4212-b4f6-b67fd49a0728 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:29.790869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a77797b-8d5c-4212-b4f6-b67fd49a0728 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:29.791298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a77797b-8d5c-4212-b4f6-b67fd49a0728 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:29.792491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a77797b-8d5c-4212-b4f6-b67fd49a0728 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:29.792804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a77797b-8d5c-4212-b4f6-b67fd49a0728 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:29.793223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a77797b-8d5c-4212-b4f6-b67fd49a0728 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:29.824771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4a77797b-8d5c-4212-b4f6-b67fd49a0728 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047495 Aug 22 19:36:29.825490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 671/1201] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:29 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:30.750616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e03a769-9c48-41fe-af27-1e1fdde19b4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:30.752816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e03a769-9c48-41fe-af27-1e1fdde19b4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:30.759341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e03a769-9c48-41fe-af27-1e1fdde19b4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:30.759875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e03a769-9c48-41fe-af27-1e1fdde19b4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:30.760315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e03a769-9c48-41fe-af27-1e1fdde19b4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:30.761020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e03a769-9c48-41fe-af27-1e1fdde19b4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:30.761473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e03a769-9c48-41fe-af27-1e1fdde19b4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:30.761906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e03a769-9c48-41fe-af27-1e1fdde19b4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:30.794477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e03a769-9c48-41fe-af27-1e1fdde19b4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047769 Aug 22 19:36:30.795043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 531/1202] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:30.838608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7c3380e5-da34-452b-9def-74dfad2c2fcd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:30.840823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7c3380e5-da34-452b-9def-74dfad2c2fcd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:30.847444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c3380e5-da34-452b-9def-74dfad2c2fcd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:30.847978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c3380e5-da34-452b-9def-74dfad2c2fcd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:30.848416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c3380e5-da34-452b-9def-74dfad2c2fcd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:30.849112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c3380e5-da34-452b-9def-74dfad2c2fcd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:30.849558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c3380e5-da34-452b-9def-74dfad2c2fcd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:30.850487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c3380e5-da34-452b-9def-74dfad2c2fcd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:30.880992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7c3380e5-da34-452b-9def-74dfad2c2fcd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Aug 22 19:36:30.881606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 672/1203] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:31.807068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5543d3d4-b7d1-495d-95a5-28adc996ad0b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:31.809199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5543d3d4-b7d1-495d-95a5-28adc996ad0b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:31.815574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5543d3d4-b7d1-495d-95a5-28adc996ad0b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:31.816083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5543d3d4-b7d1-495d-95a5-28adc996ad0b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:31.816513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5543d3d4-b7d1-495d-95a5-28adc996ad0b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:31.817206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5543d3d4-b7d1-495d-95a5-28adc996ad0b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:31.817650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5543d3d4-b7d1-495d-95a5-28adc996ad0b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:31.818065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5543d3d4-b7d1-495d-95a5-28adc996ad0b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:31.848178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5543d3d4-b7d1-495d-95a5-28adc996ad0b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045441 Aug 22 19:36:31.848742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 532/1204] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:31.894131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-559f6c0a-fc5e-4582-a41b-bdd39487f6b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:31.896391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-559f6c0a-fc5e-4582-a41b-bdd39487f6b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:31.902835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-559f6c0a-fc5e-4582-a41b-bdd39487f6b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:31.903355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-559f6c0a-fc5e-4582-a41b-bdd39487f6b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:31.903942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-559f6c0a-fc5e-4582-a41b-bdd39487f6b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:31.904660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-559f6c0a-fc5e-4582-a41b-bdd39487f6b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:31.905118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-559f6c0a-fc5e-4582-a41b-bdd39487f6b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:31.905552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-559f6c0a-fc5e-4582-a41b-bdd39487f6b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:31.936325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-559f6c0a-fc5e-4582-a41b-bdd39487f6b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046218 Aug 22 19:36:31.936904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 673/1205] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:32.860931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe40651b-f7ea-403e-aca1-ebffeea81aef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:32.863063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe40651b-f7ea-403e-aca1-ebffeea81aef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:32.869564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe40651b-f7ea-403e-aca1-ebffeea81aef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:32.870067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe40651b-f7ea-403e-aca1-ebffeea81aef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:32.870503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe40651b-f7ea-403e-aca1-ebffeea81aef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:32.871205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe40651b-f7ea-403e-aca1-ebffeea81aef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:32.871670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe40651b-f7ea-403e-aca1-ebffeea81aef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:32.872099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe40651b-f7ea-403e-aca1-ebffeea81aef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:32.902554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe40651b-f7ea-403e-aca1-ebffeea81aef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Aug 22 19:36:32.903119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 533/1206] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:32 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:32.949161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4b33621a-fc0e-40e1-bec7-ebceaafdbc0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:32.951355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4b33621a-fc0e-40e1-bec7-ebceaafdbc0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:32.957709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b33621a-fc0e-40e1-bec7-ebceaafdbc0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:32.958188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b33621a-fc0e-40e1-bec7-ebceaafdbc0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:32.958622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b33621a-fc0e-40e1-bec7-ebceaafdbc0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:32.959387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b33621a-fc0e-40e1-bec7-ebceaafdbc0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:32.960377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b33621a-fc0e-40e1-bec7-ebceaafdbc0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:32.960806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b33621a-fc0e-40e1-bec7-ebceaafdbc0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:32.991524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4b33621a-fc0e-40e1-bec7-ebceaafdbc0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Aug 22 19:36:32.992135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 674/1207] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:33.915420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80a601e4-c11d-4acc-a6c4-1c9e2483b7a2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:33.917584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80a601e4-c11d-4acc-a6c4-1c9e2483b7a2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:33.924225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a601e4-c11d-4acc-a6c4-1c9e2483b7a2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:33.924707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a601e4-c11d-4acc-a6c4-1c9e2483b7a2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:33.925140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a601e4-c11d-4acc-a6c4-1c9e2483b7a2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:33.925870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a601e4-c11d-4acc-a6c4-1c9e2483b7a2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:33.926321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a601e4-c11d-4acc-a6c4-1c9e2483b7a2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:33.926742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a601e4-c11d-4acc-a6c4-1c9e2483b7a2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:33.957146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80a601e4-c11d-4acc-a6c4-1c9e2483b7a2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046463 Aug 22 19:36:33.957718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 534/1208] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:33 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:34.007415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ea2fbe01-9ddf-48d2-9be9-66d205a08d94 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:34.010852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ea2fbe01-9ddf-48d2-9be9-66d205a08d94 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:34.020090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea2fbe01-9ddf-48d2-9be9-66d205a08d94 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:34.020573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea2fbe01-9ddf-48d2-9be9-66d205a08d94 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:34.021011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea2fbe01-9ddf-48d2-9be9-66d205a08d94 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:34.022229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea2fbe01-9ddf-48d2-9be9-66d205a08d94 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:34.022673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea2fbe01-9ddf-48d2-9be9-66d205a08d94 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:34.023107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea2fbe01-9ddf-48d2-9be9-66d205a08d94 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:34.053580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ea2fbe01-9ddf-48d2-9be9-66d205a08d94 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053266 Aug 22 19:36:34.054157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 675/1209] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:34.970081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84f54fc8-3b9f-45b2-a71b-8601c81fc109 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:34.972330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84f54fc8-3b9f-45b2-a71b-8601c81fc109 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:34.978714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84f54fc8-3b9f-45b2-a71b-8601c81fc109 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:34.979196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84f54fc8-3b9f-45b2-a71b-8601c81fc109 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:34.979631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84f54fc8-3b9f-45b2-a71b-8601c81fc109 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:34.980370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84f54fc8-3b9f-45b2-a71b-8601c81fc109 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:34.980822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84f54fc8-3b9f-45b2-a71b-8601c81fc109 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:34.981243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84f54fc8-3b9f-45b2-a71b-8601c81fc109 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:35.012383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84f54fc8-3b9f-45b2-a71b-8601c81fc109 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Aug 22 19:36:35.012865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 535/1210] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:35.066647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-324ea9b2-48b5-42ac-ac43-ef6642b22431 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:35.069484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-324ea9b2-48b5-42ac-ac43-ef6642b22431 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:35.076207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-324ea9b2-48b5-42ac-ac43-ef6642b22431 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:35.076703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-324ea9b2-48b5-42ac-ac43-ef6642b22431 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:35.077146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-324ea9b2-48b5-42ac-ac43-ef6642b22431 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:35.077861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-324ea9b2-48b5-42ac-ac43-ef6642b22431 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:35.078315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-324ea9b2-48b5-42ac-ac43-ef6642b22431 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:35.078741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-324ea9b2-48b5-42ac-ac43-ef6642b22431 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:35.109638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-324ea9b2-48b5-42ac-ac43-ef6642b22431 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047753 Aug 22 19:36:35.110504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 676/1211] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:36.025243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf690906-2cf6-4cd7-94ec-d22410f06804 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:36.027363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf690906-2cf6-4cd7-94ec-d22410f06804 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:36.034132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf690906-2cf6-4cd7-94ec-d22410f06804 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:36.034626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf690906-2cf6-4cd7-94ec-d22410f06804 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:36.035100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf690906-2cf6-4cd7-94ec-d22410f06804 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:36.035816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf690906-2cf6-4cd7-94ec-d22410f06804 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:36.036249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf690906-2cf6-4cd7-94ec-d22410f06804 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:36.036804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf690906-2cf6-4cd7-94ec-d22410f06804 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:36.067135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf690906-2cf6-4cd7-94ec-d22410f06804 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046455 Aug 22 19:36:36.067720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 536/1212] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:36.122241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f9cca1bc-dfe6-4ffb-8158-b4ea3bb2f733 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:36.124481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f9cca1bc-dfe6-4ffb-8158-b4ea3bb2f733 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:36.131699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9cca1bc-dfe6-4ffb-8158-b4ea3bb2f733 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:36.132197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9cca1bc-dfe6-4ffb-8158-b4ea3bb2f733 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:36.132634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9cca1bc-dfe6-4ffb-8158-b4ea3bb2f733 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:36.133350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9cca1bc-dfe6-4ffb-8158-b4ea3bb2f733 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:36.133807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9cca1bc-dfe6-4ffb-8158-b4ea3bb2f733 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:36.134236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9cca1bc-dfe6-4ffb-8158-b4ea3bb2f733 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:36.165500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f9cca1bc-dfe6-4ffb-8158-b4ea3bb2f733 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047201 Aug 22 19:36:36.166096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 677/1213] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:37.079339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-667d9e09-b39f-4c85-97e5-289dc18d1f32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:37.081508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-667d9e09-b39f-4c85-97e5-289dc18d1f32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:37.088308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667d9e09-b39f-4c85-97e5-289dc18d1f32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:37.088784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667d9e09-b39f-4c85-97e5-289dc18d1f32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:37.089213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667d9e09-b39f-4c85-97e5-289dc18d1f32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:37.089901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667d9e09-b39f-4c85-97e5-289dc18d1f32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:37.090347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667d9e09-b39f-4c85-97e5-289dc18d1f32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:37.090775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-667d9e09-b39f-4c85-97e5-289dc18d1f32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:37.121137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-667d9e09-b39f-4c85-97e5-289dc18d1f32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Aug 22 19:36:37.121706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 537/1214] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:37.178580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3a62e4ef-5a16-437f-ab76-e4de5d1f41bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:37.180742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3a62e4ef-5a16-437f-ab76-e4de5d1f41bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:37.187403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a62e4ef-5a16-437f-ab76-e4de5d1f41bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:37.187950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a62e4ef-5a16-437f-ab76-e4de5d1f41bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:37.188362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a62e4ef-5a16-437f-ab76-e4de5d1f41bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:37.189079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a62e4ef-5a16-437f-ab76-e4de5d1f41bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:37.189491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a62e4ef-5a16-437f-ab76-e4de5d1f41bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:37.190084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a62e4ef-5a16-437f-ab76-e4de5d1f41bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:37.221661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3a62e4ef-5a16-437f-ab76-e4de5d1f41bc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047498 Aug 22 19:36:37.222251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 678/1215] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:38.133379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ef83869-65c5-4d56-a5a2-9ab4c4cb80b8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:38.135504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ef83869-65c5-4d56-a5a2-9ab4c4cb80b8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:38.144417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ef83869-65c5-4d56-a5a2-9ab4c4cb80b8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:38.144417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ef83869-65c5-4d56-a5a2-9ab4c4cb80b8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:38.144417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ef83869-65c5-4d56-a5a2-9ab4c4cb80b8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:38.144417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ef83869-65c5-4d56-a5a2-9ab4c4cb80b8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:38.144866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ef83869-65c5-4d56-a5a2-9ab4c4cb80b8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:38.144866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ef83869-65c5-4d56-a5a2-9ab4c4cb80b8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:38.178669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ef83869-65c5-4d56-a5a2-9ab4c4cb80b8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048598 Aug 22 19:36:38.179234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 538/1216] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:38.234081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7fb19e9a-cd47-44b4-bbad-e9891a002cec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:38.237603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7fb19e9a-cd47-44b4-bbad-e9891a002cec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:38.244724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fb19e9a-cd47-44b4-bbad-e9891a002cec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:38.245253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fb19e9a-cd47-44b4-bbad-e9891a002cec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:38.245698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fb19e9a-cd47-44b4-bbad-e9891a002cec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:38.246414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fb19e9a-cd47-44b4-bbad-e9891a002cec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:38.246871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fb19e9a-cd47-44b4-bbad-e9891a002cec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:38.247298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7fb19e9a-cd47-44b4-bbad-e9891a002cec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:38.277682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7fb19e9a-cd47-44b4-bbad-e9891a002cec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047587 Aug 22 19:36:38.278354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 679/1217] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:39.190546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b72517a7-da2d-4668-90e2-5ec6cda4f905 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:39.192692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b72517a7-da2d-4668-90e2-5ec6cda4f905 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:39.199891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b72517a7-da2d-4668-90e2-5ec6cda4f905 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:39.200369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b72517a7-da2d-4668-90e2-5ec6cda4f905 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:39.200797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b72517a7-da2d-4668-90e2-5ec6cda4f905 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:39.201489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b72517a7-da2d-4668-90e2-5ec6cda4f905 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:39.201942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b72517a7-da2d-4668-90e2-5ec6cda4f905 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:39.202354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b72517a7-da2d-4668-90e2-5ec6cda4f905 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:39.235049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b72517a7-da2d-4668-90e2-5ec6cda4f905 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048416 Aug 22 19:36:39.235891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 539/1218] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:39 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:39.290049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ed17baa1-869d-4b62-8211-2af8067f1925 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:39.292287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ed17baa1-869d-4b62-8211-2af8067f1925 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:39.298966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed17baa1-869d-4b62-8211-2af8067f1925 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:39.299458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed17baa1-869d-4b62-8211-2af8067f1925 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:39.299932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed17baa1-869d-4b62-8211-2af8067f1925 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:39.300641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed17baa1-869d-4b62-8211-2af8067f1925 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:39.301096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed17baa1-869d-4b62-8211-2af8067f1925 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:39.301524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed17baa1-869d-4b62-8211-2af8067f1925 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:39.333213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ed17baa1-869d-4b62-8211-2af8067f1925 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047187 Aug 22 19:36:39.333802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 680/1219] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:40.246765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7fba2d86-0dd6-4338-a3dd-e77d053acaa1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:40.249109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7fba2d86-0dd6-4338-a3dd-e77d053acaa1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:40.255967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fba2d86-0dd6-4338-a3dd-e77d053acaa1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:40.256411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fba2d86-0dd6-4338-a3dd-e77d053acaa1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:40.256935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fba2d86-0dd6-4338-a3dd-e77d053acaa1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:40.257660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fba2d86-0dd6-4338-a3dd-e77d053acaa1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:40.258812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fba2d86-0dd6-4338-a3dd-e77d053acaa1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:40.259266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7fba2d86-0dd6-4338-a3dd-e77d053acaa1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:40.291402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7fba2d86-0dd6-4338-a3dd-e77d053acaa1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048721 Aug 22 19:36:40.292003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 540/1220] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:40.346143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-89b3f811-c490-4b61-9475-9aade964bab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:40.348465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-89b3f811-c490-4b61-9475-9aade964bab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:40.355130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b3f811-c490-4b61-9475-9aade964bab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:40.355553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b3f811-c490-4b61-9475-9aade964bab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:40.356016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b3f811-c490-4b61-9475-9aade964bab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:40.356733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b3f811-c490-4b61-9475-9aade964bab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:40.357211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b3f811-c490-4b61-9475-9aade964bab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:40.357611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89b3f811-c490-4b61-9475-9aade964bab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:40.388726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-89b3f811-c490-4b61-9475-9aade964bab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Aug 22 19:36:40.389308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 681/1221] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:41.303417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cc33603-0fd3-47f2-a2e6-e6eb289f76dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:41.305661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cc33603-0fd3-47f2-a2e6-e6eb289f76dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:41.312214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc33603-0fd3-47f2-a2e6-e6eb289f76dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:41.312698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc33603-0fd3-47f2-a2e6-e6eb289f76dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:41.313139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc33603-0fd3-47f2-a2e6-e6eb289f76dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:41.313846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc33603-0fd3-47f2-a2e6-e6eb289f76dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:41.314300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc33603-0fd3-47f2-a2e6-e6eb289f76dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:41.315222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc33603-0fd3-47f2-a2e6-e6eb289f76dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:41.342950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:36:41.348266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cc33603-0fd3-47f2-a2e6-e6eb289f76dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049404 Aug 22 19:36:41.348851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 541/1222] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:41.400995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5c1207e6-b85c-47ef-91a5-a256f5049549 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:41.403216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5c1207e6-b85c-47ef-91a5-a256f5049549 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:41.409906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c1207e6-b85c-47ef-91a5-a256f5049549 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:41.410379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c1207e6-b85c-47ef-91a5-a256f5049549 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:41.410809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c1207e6-b85c-47ef-91a5-a256f5049549 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:41.411505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c1207e6-b85c-47ef-91a5-a256f5049549 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:41.411974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c1207e6-b85c-47ef-91a5-a256f5049549 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:41.412977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c1207e6-b85c-47ef-91a5-a256f5049549 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:41.430587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:36:41.446509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5c1207e6-b85c-47ef-91a5-a256f5049549 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049364 Aug 22 19:36:41.447100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 682/1223] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:42.361737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-414b1373-8e3f-4873-8868-b2d3a0bb2fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:42.364325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-414b1373-8e3f-4873-8868-b2d3a0bb2fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:42.370494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-414b1373-8e3f-4873-8868-b2d3a0bb2fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:42.370972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-414b1373-8e3f-4873-8868-b2d3a0bb2fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:42.371407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-414b1373-8e3f-4873-8868-b2d3a0bb2fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:42.372267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-414b1373-8e3f-4873-8868-b2d3a0bb2fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:42.372709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-414b1373-8e3f-4873-8868-b2d3a0bb2fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:42.373135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-414b1373-8e3f-4873-8868-b2d3a0bb2fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:42.403535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-414b1373-8e3f-4873-8868-b2d3a0bb2fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046061 Aug 22 19:36:42.404143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 542/1224] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:42.459123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6223cee8-c7d8-410e-952b-cae1a1aa31b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:42.462007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6223cee8-c7d8-410e-952b-cae1a1aa31b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:42.468874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6223cee8-c7d8-410e-952b-cae1a1aa31b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:42.469353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6223cee8-c7d8-410e-952b-cae1a1aa31b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:42.469791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6223cee8-c7d8-410e-952b-cae1a1aa31b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:42.470497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6223cee8-c7d8-410e-952b-cae1a1aa31b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:42.470946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6223cee8-c7d8-410e-952b-cae1a1aa31b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:42.471382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6223cee8-c7d8-410e-952b-cae1a1aa31b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:42.502409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6223cee8-c7d8-410e-952b-cae1a1aa31b4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047229 Aug 22 19:36:42.503031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 683/1225] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:43.416760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0569d00-a6db-45a0-935c-67b069637a76 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:43.418890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0569d00-a6db-45a0-935c-67b069637a76 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:43.421273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=71 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:36:43.426464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0569d00-a6db-45a0-935c-67b069637a76 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:43.426943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0569d00-a6db-45a0-935c-67b069637a76 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:43.427369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0569d00-a6db-45a0-935c-67b069637a76 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:43.428090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0569d00-a6db-45a0-935c-67b069637a76 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:43.428544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0569d00-a6db-45a0-935c-67b069637a76 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:43.428960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0569d00-a6db-45a0-935c-67b069637a76 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:43.461011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0569d00-a6db-45a0-935c-67b069637a76 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048198 Aug 22 19:36:43.461592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 543/1226] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:43.517482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-36a4b79c-0648-40ed-a023-cf6aeba6518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:43.519698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-36a4b79c-0648-40ed-a023-cf6aeba6518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:43.522048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=71 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:36:43.527991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a4b79c-0648-40ed-a023-cf6aeba6518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:43.528485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a4b79c-0648-40ed-a023-cf6aeba6518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:43.528926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a4b79c-0648-40ed-a023-cf6aeba6518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:43.529637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a4b79c-0648-40ed-a023-cf6aeba6518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:43.530092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a4b79c-0648-40ed-a023-cf6aeba6518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:43.530523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a4b79c-0648-40ed-a023-cf6aeba6518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:43.560801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-36a4b79c-0648-40ed-a023-cf6aeba6518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047174 Aug 22 19:36:43.561391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 684/1227] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:43 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:44.473439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f00a2fa-5fb7-4c42-ab22-846e8fbbeda8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:44.476177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f00a2fa-5fb7-4c42-ab22-846e8fbbeda8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:44.482721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f00a2fa-5fb7-4c42-ab22-846e8fbbeda8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:44.483199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f00a2fa-5fb7-4c42-ab22-846e8fbbeda8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:44.483626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f00a2fa-5fb7-4c42-ab22-846e8fbbeda8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:44.484343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f00a2fa-5fb7-4c42-ab22-846e8fbbeda8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:44.484818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f00a2fa-5fb7-4c42-ab22-846e8fbbeda8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:44.485239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f00a2fa-5fb7-4c42-ab22-846e8fbbeda8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:44.516628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f00a2fa-5fb7-4c42-ab22-846e8fbbeda8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047015 Aug 22 19:36:44.517193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 544/1228] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:44 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:44.572696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2bfa873d-7b19-4285-8632-e0b8ab510e3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:44.574977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2bfa873d-7b19-4285-8632-e0b8ab510e3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:44.582179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfa873d-7b19-4285-8632-e0b8ab510e3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:44.582646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfa873d-7b19-4285-8632-e0b8ab510e3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:44.583085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfa873d-7b19-4285-8632-e0b8ab510e3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:44.583839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfa873d-7b19-4285-8632-e0b8ab510e3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:44.584337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfa873d-7b19-4285-8632-e0b8ab510e3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:44.585232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfa873d-7b19-4285-8632-e0b8ab510e3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:44.619222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2bfa873d-7b19-4285-8632-e0b8ab510e3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050495 Aug 22 19:36:44.620784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 685/1229] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:45.528707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9709895d-76e3-4ad8-afef-8bef31b49f79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:45.530822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9709895d-76e3-4ad8-afef-8bef31b49f79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:45.537474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9709895d-76e3-4ad8-afef-8bef31b49f79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:45.538473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9709895d-76e3-4ad8-afef-8bef31b49f79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:45.538901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9709895d-76e3-4ad8-afef-8bef31b49f79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:45.539599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9709895d-76e3-4ad8-afef-8bef31b49f79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:45.540075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9709895d-76e3-4ad8-afef-8bef31b49f79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:45.540491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9709895d-76e3-4ad8-afef-8bef31b49f79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:45.570949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9709895d-76e3-4ad8-afef-8bef31b49f79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046059 Aug 22 19:36:45.571504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 545/1230] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:45 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:45.632152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0f328ec1-9168-4798-bfcf-04470939302d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:45.634337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0f328ec1-9168-4798-bfcf-04470939302d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:45.641020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f328ec1-9168-4798-bfcf-04470939302d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:45.641515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f328ec1-9168-4798-bfcf-04470939302d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:45.641953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f328ec1-9168-4798-bfcf-04470939302d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:45.642662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f328ec1-9168-4798-bfcf-04470939302d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:45.643117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f328ec1-9168-4798-bfcf-04470939302d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:45.643545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f328ec1-9168-4798-bfcf-04470939302d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:45.674728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0f328ec1-9168-4798-bfcf-04470939302d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046562 Aug 22 19:36:45.675491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 686/1231] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:46.582290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73acfb40-fac0-4e4d-849c-77fef0e2b764 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:46.584520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73acfb40-fac0-4e4d-849c-77fef0e2b764 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:46.591284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73acfb40-fac0-4e4d-849c-77fef0e2b764 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:46.591805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73acfb40-fac0-4e4d-849c-77fef0e2b764 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:46.592238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73acfb40-fac0-4e4d-849c-77fef0e2b764 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:46.592935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73acfb40-fac0-4e4d-849c-77fef0e2b764 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:46.593379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73acfb40-fac0-4e4d-849c-77fef0e2b764 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:46.593801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73acfb40-fac0-4e4d-849c-77fef0e2b764 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:46.624589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73acfb40-fac0-4e4d-849c-77fef0e2b764 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Aug 22 19:36:46.625157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 546/1232] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:46.687490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2dd9ad0e-7ac5-45c9-b166-ffe409f05aa6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:46.689733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2dd9ad0e-7ac5-45c9-b166-ffe409f05aa6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:46.696289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad0e-7ac5-45c9-b166-ffe409f05aa6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:46.696777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad0e-7ac5-45c9-b166-ffe409f05aa6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:46.697210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad0e-7ac5-45c9-b166-ffe409f05aa6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:46.697912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad0e-7ac5-45c9-b166-ffe409f05aa6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:46.698359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad0e-7ac5-45c9-b166-ffe409f05aa6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:46.698785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dd9ad0e-7ac5-45c9-b166-ffe409f05aa6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:46.730549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2dd9ad0e-7ac5-45c9-b166-ffe409f05aa6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046923 Aug 22 19:36:46.731133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 687/1233] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:47.230547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:36:47.230813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:36:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:36:47.636692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-feac1868-8d36-4189-90f5-e73ddd6422d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:47.638897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-feac1868-8d36-4189-90f5-e73ddd6422d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:47.645521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feac1868-8d36-4189-90f5-e73ddd6422d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:47.645997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feac1868-8d36-4189-90f5-e73ddd6422d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:47.646427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feac1868-8d36-4189-90f5-e73ddd6422d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:47.647628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feac1868-8d36-4189-90f5-e73ddd6422d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:47.648104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feac1868-8d36-4189-90f5-e73ddd6422d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:47.648521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-feac1868-8d36-4189-90f5-e73ddd6422d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:47.678740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-feac1868-8d36-4189-90f5-e73ddd6422d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Aug 22 19:36:47.679302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 547/1234] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:47.742650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f626da00-49e6-4413-add7-08b112e6fdaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:47.744887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f626da00-49e6-4413-add7-08b112e6fdaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:47.751933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f626da00-49e6-4413-add7-08b112e6fdaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:47.752417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f626da00-49e6-4413-add7-08b112e6fdaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:47.752850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f626da00-49e6-4413-add7-08b112e6fdaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:47.753550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f626da00-49e6-4413-add7-08b112e6fdaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:47.753998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f626da00-49e6-4413-add7-08b112e6fdaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:47.754510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f626da00-49e6-4413-add7-08b112e6fdaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:47.786574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f626da00-49e6-4413-add7-08b112e6fdaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047797 Aug 22 19:36:47.787146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 688/1235] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:48.692993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-944ce296-5314-4223-80dd-b9e2d437b3e8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:48.695806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-944ce296-5314-4223-80dd-b9e2d437b3e8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:48.702391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-944ce296-5314-4223-80dd-b9e2d437b3e8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:48.702879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-944ce296-5314-4223-80dd-b9e2d437b3e8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:48.703322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-944ce296-5314-4223-80dd-b9e2d437b3e8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:48.704057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-944ce296-5314-4223-80dd-b9e2d437b3e8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:48.704513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-944ce296-5314-4223-80dd-b9e2d437b3e8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:48.704939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-944ce296-5314-4223-80dd-b9e2d437b3e8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:48.735622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-944ce296-5314-4223-80dd-b9e2d437b3e8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049022 Aug 22 19:36:48.736324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 548/1236] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:48.799276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-97ac00e2-5677-444f-bbba-cafab51b329d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:48.801447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-97ac00e2-5677-444f-bbba-cafab51b329d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:48.808524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97ac00e2-5677-444f-bbba-cafab51b329d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:48.809004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97ac00e2-5677-444f-bbba-cafab51b329d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:48.809431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97ac00e2-5677-444f-bbba-cafab51b329d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:48.810125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97ac00e2-5677-444f-bbba-cafab51b329d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:48.810672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97ac00e2-5677-444f-bbba-cafab51b329d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:48.811090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97ac00e2-5677-444f-bbba-cafab51b329d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:48.845947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-97ac00e2-5677-444f-bbba-cafab51b329d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050651 Aug 22 19:36:48.846737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 689/1237] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:49.747461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a805fdaf-7568-48fc-9118-cc33cea519f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:49.749794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a805fdaf-7568-48fc-9118-cc33cea519f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:49.756569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a805fdaf-7568-48fc-9118-cc33cea519f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:49.757054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a805fdaf-7568-48fc-9118-cc33cea519f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:49.757483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a805fdaf-7568-48fc-9118-cc33cea519f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:49.758181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a805fdaf-7568-48fc-9118-cc33cea519f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:49.758627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a805fdaf-7568-48fc-9118-cc33cea519f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:49.759212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a805fdaf-7568-48fc-9118-cc33cea519f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:49.796771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a805fdaf-7568-48fc-9118-cc33cea519f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053287 Aug 22 19:36:49.797336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 549/1238] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:49.858977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-16220036-5f9c-458a-b8d2-7867c5fefbc2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:49.861203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-16220036-5f9c-458a-b8d2-7867c5fefbc2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:49.867581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16220036-5f9c-458a-b8d2-7867c5fefbc2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:49.868085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16220036-5f9c-458a-b8d2-7867c5fefbc2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:49.868517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16220036-5f9c-458a-b8d2-7867c5fefbc2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:49.869203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16220036-5f9c-458a-b8d2-7867c5fefbc2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:49.869649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16220036-5f9c-458a-b8d2-7867c5fefbc2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:49.870066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16220036-5f9c-458a-b8d2-7867c5fefbc2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:49.899890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-16220036-5f9c-458a-b8d2-7867c5fefbc2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Aug 22 19:36:49.900440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 690/1239] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:50.809159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-664cbcd2-7a9d-478f-aa83-89ce2dec30eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:50.811203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-664cbcd2-7a9d-478f-aa83-89ce2dec30eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:50.817907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664cbcd2-7a9d-478f-aa83-89ce2dec30eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:50.818387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664cbcd2-7a9d-478f-aa83-89ce2dec30eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:50.818822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664cbcd2-7a9d-478f-aa83-89ce2dec30eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:50.820066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664cbcd2-7a9d-478f-aa83-89ce2dec30eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:50.820513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664cbcd2-7a9d-478f-aa83-89ce2dec30eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:50.820932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664cbcd2-7a9d-478f-aa83-89ce2dec30eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:50.852009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-664cbcd2-7a9d-478f-aa83-89ce2dec30eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 Aug 22 19:36:50.852583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 550/1240] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:50 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:50.912228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9e3bba86-1b08-45f1-926f-7cd7f6ccd7e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:50.914421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9e3bba86-1b08-45f1-926f-7cd7f6ccd7e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:50.921187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e3bba86-1b08-45f1-926f-7cd7f6ccd7e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:50.921667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e3bba86-1b08-45f1-926f-7cd7f6ccd7e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:50.922100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e3bba86-1b08-45f1-926f-7cd7f6ccd7e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:50.922788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e3bba86-1b08-45f1-926f-7cd7f6ccd7e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:50.923234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e3bba86-1b08-45f1-926f-7cd7f6ccd7e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:50.923671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e3bba86-1b08-45f1-926f-7cd7f6ccd7e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:50.953423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9e3bba86-1b08-45f1-926f-7cd7f6ccd7e8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045077 Aug 22 19:36:50.953997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 691/1241] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:51.864428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9246a6c-4727-47d5-a816-061e4b501bd2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:51.866607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d9246a6c-4727-47d5-a816-061e4b501bd2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:51.873281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9246a6c-4727-47d5-a816-061e4b501bd2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:51.873763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9246a6c-4727-47d5-a816-061e4b501bd2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:51.874197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9246a6c-4727-47d5-a816-061e4b501bd2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:51.874894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9246a6c-4727-47d5-a816-061e4b501bd2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:51.875338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9246a6c-4727-47d5-a816-061e4b501bd2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:51.875783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9246a6c-4727-47d5-a816-061e4b501bd2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:51.907356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9246a6c-4727-47d5-a816-061e4b501bd2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046828 Aug 22 19:36:51.907973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 551/1242] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:51 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:51.966668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3130c572-f7a3-4339-a08f-422a2b17e299 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:51.968871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3130c572-f7a3-4339-a08f-422a2b17e299 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:51.976087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3130c572-f7a3-4339-a08f-422a2b17e299 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:51.976567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3130c572-f7a3-4339-a08f-422a2b17e299 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:51.976994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3130c572-f7a3-4339-a08f-422a2b17e299 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:51.977689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3130c572-f7a3-4339-a08f-422a2b17e299 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:51.978132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3130c572-f7a3-4339-a08f-422a2b17e299 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:51.978551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3130c572-f7a3-4339-a08f-422a2b17e299 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:52.009918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3130c572-f7a3-4339-a08f-422a2b17e299 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047577 Aug 22 19:36:52.010499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 692/1243] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:52.919616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e502d324-feda-4cb1-9802-258b00d4ba2e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:52.921762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e502d324-feda-4cb1-9802-258b00d4ba2e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:52.928896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e502d324-feda-4cb1-9802-258b00d4ba2e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:52.929321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e502d324-feda-4cb1-9802-258b00d4ba2e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:52.929747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e502d324-feda-4cb1-9802-258b00d4ba2e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:52.930442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e502d324-feda-4cb1-9802-258b00d4ba2e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:52.930885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e502d324-feda-4cb1-9802-258b00d4ba2e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:52.931323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e502d324-feda-4cb1-9802-258b00d4ba2e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:52.961324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e502d324-feda-4cb1-9802-258b00d4ba2e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045501 Aug 22 19:36:52.961884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 552/1244] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:53.022696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-02831079-d96a-4e72-834a-93c9087bc017 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:53.024897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-02831079-d96a-4e72-834a-93c9087bc017 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:53.031491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02831079-d96a-4e72-834a-93c9087bc017 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:53.032023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02831079-d96a-4e72-834a-93c9087bc017 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:53.032464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02831079-d96a-4e72-834a-93c9087bc017 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:53.033174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02831079-d96a-4e72-834a-93c9087bc017 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:53.033628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02831079-d96a-4e72-834a-93c9087bc017 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:53.034055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02831079-d96a-4e72-834a-93c9087bc017 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:53.064719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-02831079-d96a-4e72-834a-93c9087bc017 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046053 Aug 22 19:36:53.065300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 693/1245] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:53.973027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-838a07f6-25e2-4ad1-8677-cb89fd9f9605 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:53.975169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-838a07f6-25e2-4ad1-8677-cb89fd9f9605 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:53.988407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838a07f6-25e2-4ad1-8677-cb89fd9f9605 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:53.988991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838a07f6-25e2-4ad1-8677-cb89fd9f9605 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:53.989437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838a07f6-25e2-4ad1-8677-cb89fd9f9605 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:53.990156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838a07f6-25e2-4ad1-8677-cb89fd9f9605 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:53.990604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838a07f6-25e2-4ad1-8677-cb89fd9f9605 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:53.991055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838a07f6-25e2-4ad1-8677-cb89fd9f9605 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:54.021650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-838a07f6-25e2-4ad1-8677-cb89fd9f9605 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052561 Aug 22 19:36:54.022793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 553/1246] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:54.076604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9d9cebc5-fb90-45c1-86d2-7fffb02331b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:54.078878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9d9cebc5-fb90-45c1-86d2-7fffb02331b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:54.086038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d9cebc5-fb90-45c1-86d2-7fffb02331b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:54.086512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d9cebc5-fb90-45c1-86d2-7fffb02331b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:54.086945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d9cebc5-fb90-45c1-86d2-7fffb02331b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:54.087966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d9cebc5-fb90-45c1-86d2-7fffb02331b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:54.088411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d9cebc5-fb90-45c1-86d2-7fffb02331b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:54.088828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d9cebc5-fb90-45c1-86d2-7fffb02331b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:54.118900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9d9cebc5-fb90-45c1-86d2-7fffb02331b1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046198 Aug 22 19:36:54.119511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 694/1247] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:55.034814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0fbc918c-2ead-443d-b846-7da6a3a8bd50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:55.036996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0fbc918c-2ead-443d-b846-7da6a3a8bd50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:55.043406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fbc918c-2ead-443d-b846-7da6a3a8bd50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:55.043907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fbc918c-2ead-443d-b846-7da6a3a8bd50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:55.044335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fbc918c-2ead-443d-b846-7da6a3a8bd50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:55.045030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fbc918c-2ead-443d-b846-7da6a3a8bd50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:55.045474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fbc918c-2ead-443d-b846-7da6a3a8bd50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:55.045888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fbc918c-2ead-443d-b846-7da6a3a8bd50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:55.076568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0fbc918c-2ead-443d-b846-7da6a3a8bd50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Aug 22 19:36:55.077048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 554/1248] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:55 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:36:55.130534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eea6279e-97fb-4521-9479-02dd1bd3cc97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:55.133274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eea6279e-97fb-4521-9479-02dd1bd3cc97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:55.139804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea6279e-97fb-4521-9479-02dd1bd3cc97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:55.140287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea6279e-97fb-4521-9479-02dd1bd3cc97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:55.140723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea6279e-97fb-4521-9479-02dd1bd3cc97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:55.141423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea6279e-97fb-4521-9479-02dd1bd3cc97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:55.141873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea6279e-97fb-4521-9479-02dd1bd3cc97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:55.142294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea6279e-97fb-4521-9479-02dd1bd3cc97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:55.172189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eea6279e-97fb-4521-9479-02dd1bd3cc97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Aug 22 19:36:55.172770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 695/1249] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:56.089751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b4a5ddd3-6443-4a4b-810e-94b0e3a8ac03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:56.091931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b4a5ddd3-6443-4a4b-810e-94b0e3a8ac03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:56.098358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4a5ddd3-6443-4a4b-810e-94b0e3a8ac03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:56.098835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4a5ddd3-6443-4a4b-810e-94b0e3a8ac03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:56.099277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4a5ddd3-6443-4a4b-810e-94b0e3a8ac03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:56.100000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4a5ddd3-6443-4a4b-810e-94b0e3a8ac03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:56.100448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4a5ddd3-6443-4a4b-810e-94b0e3a8ac03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:56.100863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4a5ddd3-6443-4a4b-810e-94b0e3a8ac03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:56.131160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b4a5ddd3-6443-4a4b-810e-94b0e3a8ac03 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046131 Aug 22 19:36:56.132189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 555/1250] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:56 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:56.184477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-097a0066-dd95-4889-ac52-9fd48e8f204a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:56.186671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-097a0066-dd95-4889-ac52-9fd48e8f204a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:56.193170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-097a0066-dd95-4889-ac52-9fd48e8f204a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:56.193650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-097a0066-dd95-4889-ac52-9fd48e8f204a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:56.194590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-097a0066-dd95-4889-ac52-9fd48e8f204a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:56.195314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-097a0066-dd95-4889-ac52-9fd48e8f204a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:56.195801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-097a0066-dd95-4889-ac52-9fd48e8f204a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:56.196227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-097a0066-dd95-4889-ac52-9fd48e8f204a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:56.228429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-097a0066-dd95-4889-ac52-9fd48e8f204a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047843 Aug 22 19:36:56.228997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 696/1251] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:57.144316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e4b43bd-8479-44f4-8c2a-5db38a5077e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:57.148815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e4b43bd-8479-44f4-8c2a-5db38a5077e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:57.156630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b43bd-8479-44f4-8c2a-5db38a5077e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:57.157277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b43bd-8479-44f4-8c2a-5db38a5077e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:57.157746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b43bd-8479-44f4-8c2a-5db38a5077e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:57.158467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b43bd-8479-44f4-8c2a-5db38a5077e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:57.158921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b43bd-8479-44f4-8c2a-5db38a5077e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:57.159345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4b43bd-8479-44f4-8c2a-5db38a5077e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:57.190636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e4b43bd-8479-44f4-8c2a-5db38a5077e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050352 Aug 22 19:36:57.191213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 556/1252] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:57 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:57.240928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c7277a95-1d87-4bfb-8118-04514f8a4779 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:57.243074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c7277a95-1d87-4bfb-8118-04514f8a4779 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:57.252535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7277a95-1d87-4bfb-8118-04514f8a4779 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:57.253028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7277a95-1d87-4bfb-8118-04514f8a4779 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:57.253464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7277a95-1d87-4bfb-8118-04514f8a4779 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:57.254175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7277a95-1d87-4bfb-8118-04514f8a4779 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:57.254630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7277a95-1d87-4bfb-8118-04514f8a4779 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:57.255058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7277a95-1d87-4bfb-8118-04514f8a4779 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:57.285476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c7277a95-1d87-4bfb-8118-04514f8a4779 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048539 Aug 22 19:36:57.286046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 697/1253] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:58.202683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d304b23f-e97e-4aea-a686-1d47a39a2ab3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:58.204881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d304b23f-e97e-4aea-a686-1d47a39a2ab3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:58.211530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d304b23f-e97e-4aea-a686-1d47a39a2ab3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:58.212536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d304b23f-e97e-4aea-a686-1d47a39a2ab3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:58.213119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d304b23f-e97e-4aea-a686-1d47a39a2ab3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:58.214004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d304b23f-e97e-4aea-a686-1d47a39a2ab3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:58.214616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d304b23f-e97e-4aea-a686-1d47a39a2ab3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:58.215195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d304b23f-e97e-4aea-a686-1d47a39a2ab3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:58.246800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d304b23f-e97e-4aea-a686-1d47a39a2ab3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048240 Aug 22 19:36:58.247354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 557/1254] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:58 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:58.298624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-18f9d8c2-fe2c-49d2-8190-005bfdcefad7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:58.300826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-18f9d8c2-fe2c-49d2-8190-005bfdcefad7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:58.307396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18f9d8c2-fe2c-49d2-8190-005bfdcefad7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:58.307916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18f9d8c2-fe2c-49d2-8190-005bfdcefad7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:58.308353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18f9d8c2-fe2c-49d2-8190-005bfdcefad7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:58.309360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18f9d8c2-fe2c-49d2-8190-005bfdcefad7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:58.309611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18f9d8c2-fe2c-49d2-8190-005bfdcefad7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:58.310039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18f9d8c2-fe2c-49d2-8190-005bfdcefad7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:58.341056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-18f9d8c2-fe2c-49d2-8190-005bfdcefad7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046518 Aug 22 19:36:58.341619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 698/1255] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:59.258514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2abf7a72-31f2-44e8-8b9d-2bd8779d1836 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:59.260979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2abf7a72-31f2-44e8-8b9d-2bd8779d1836 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:59.268124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2abf7a72-31f2-44e8-8b9d-2bd8779d1836 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:59.268601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2abf7a72-31f2-44e8-8b9d-2bd8779d1836 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:59.269034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2abf7a72-31f2-44e8-8b9d-2bd8779d1836 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:59.272079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2abf7a72-31f2-44e8-8b9d-2bd8779d1836 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:59.272079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2abf7a72-31f2-44e8-8b9d-2bd8779d1836 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:59.272079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2abf7a72-31f2-44e8-8b9d-2bd8779d1836 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:59.288333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:36:59.302343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2abf7a72-31f2-44e8-8b9d-2bd8779d1836 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047854 Aug 22 19:36:59.302912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 558/1256] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:59 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:36:59.353079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3f8bf4a8-924d-413b-a4f4-bcf806aa22d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:36:59.355237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3f8bf4a8-924d-413b-a4f4-bcf806aa22d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:36:59.361810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f8bf4a8-924d-413b-a4f4-bcf806aa22d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:59.362292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f8bf4a8-924d-413b-a4f4-bcf806aa22d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:59.362728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f8bf4a8-924d-413b-a4f4-bcf806aa22d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:59.363433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f8bf4a8-924d-413b-a4f4-bcf806aa22d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:36:59.363919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f8bf4a8-924d-413b-a4f4-bcf806aa22d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:36:59.364344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f8bf4a8-924d-413b-a4f4-bcf806aa22d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:36:59.369182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:36:59.395252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3f8bf4a8-924d-413b-a4f4-bcf806aa22d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046557 Aug 22 19:36:59.395853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 699/1257] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:36:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:00.314402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93bb4cf7-a8eb-47d7-bf7b-388f6f85279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:00.316575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93bb4cf7-a8eb-47d7-bf7b-388f6f85279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:00.324399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93bb4cf7-a8eb-47d7-bf7b-388f6f85279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:00.324879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93bb4cf7-a8eb-47d7-bf7b-388f6f85279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:00.325307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93bb4cf7-a8eb-47d7-bf7b-388f6f85279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:00.326000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93bb4cf7-a8eb-47d7-bf7b-388f6f85279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:00.326444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93bb4cf7-a8eb-47d7-bf7b-388f6f85279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:00.326856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93bb4cf7-a8eb-47d7-bf7b-388f6f85279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:00.357983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93bb4cf7-a8eb-47d7-bf7b-388f6f85279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047469 Aug 22 19:37:00.358563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 559/1258] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:00 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:00.409191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c37236be-9fb9-4142-a116-cba7bdee47b9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:00.411339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c37236be-9fb9-4142-a116-cba7bdee47b9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:00.418016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c37236be-9fb9-4142-a116-cba7bdee47b9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:00.418513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c37236be-9fb9-4142-a116-cba7bdee47b9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:00.418949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c37236be-9fb9-4142-a116-cba7bdee47b9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:00.419711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c37236be-9fb9-4142-a116-cba7bdee47b9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:00.420156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c37236be-9fb9-4142-a116-cba7bdee47b9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:00.420585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c37236be-9fb9-4142-a116-cba7bdee47b9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:00.451037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c37236be-9fb9-4142-a116-cba7bdee47b9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045729 Aug 22 19:37:00.451660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 700/1259] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:37:01.370463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a16dd4c9-a676-45ea-8448-77d9961a37a9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:01.372675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a16dd4c9-a676-45ea-8448-77d9961a37a9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:01.379584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16dd4c9-a676-45ea-8448-77d9961a37a9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:01.380143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16dd4c9-a676-45ea-8448-77d9961a37a9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:01.380534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16dd4c9-a676-45ea-8448-77d9961a37a9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:01.381739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16dd4c9-a676-45ea-8448-77d9961a37a9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:01.382195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16dd4c9-a676-45ea-8448-77d9961a37a9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:01.382612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a16dd4c9-a676-45ea-8448-77d9961a37a9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:01.413482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a16dd4c9-a676-45ea-8448-77d9961a37a9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047107 Aug 22 19:37:01.414050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 560/1260] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:01 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:01.464311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-16a23483-a6bc-4e61-820b-b7669311011e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:01.466496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-16a23483-a6bc-4e61-820b-b7669311011e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:01.472740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16a23483-a6bc-4e61-820b-b7669311011e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:01.473223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16a23483-a6bc-4e61-820b-b7669311011e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:01.473652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16a23483-a6bc-4e61-820b-b7669311011e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:01.474349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16a23483-a6bc-4e61-820b-b7669311011e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:01.474796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16a23483-a6bc-4e61-820b-b7669311011e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:01.475219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16a23483-a6bc-4e61-820b-b7669311011e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:01.505982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-16a23483-a6bc-4e61-820b-b7669311011e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046517 Aug 22 19:37:01.507078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 701/1261] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:02.425917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90535416-6a7f-4db1-9aba-2095aa57db7e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:02.428012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90535416-6a7f-4db1-9aba-2095aa57db7e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:02.435258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90535416-6a7f-4db1-9aba-2095aa57db7e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:02.435774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90535416-6a7f-4db1-9aba-2095aa57db7e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:02.436213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90535416-6a7f-4db1-9aba-2095aa57db7e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:02.436916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90535416-6a7f-4db1-9aba-2095aa57db7e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:02.437369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90535416-6a7f-4db1-9aba-2095aa57db7e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:02.437798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90535416-6a7f-4db1-9aba-2095aa57db7e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:02.468878 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90535416-6a7f-4db1-9aba-2095aa57db7e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047101 Aug 22 19:37:02.469452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 561/1262] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:02 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:02.518929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f3b59a70-1a49-405a-b569-405125ffa3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:02.521119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f3b59a70-1a49-405a-b569-405125ffa3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:02.528247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b59a70-1a49-405a-b569-405125ffa3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:02.528728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b59a70-1a49-405a-b569-405125ffa3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:02.529160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b59a70-1a49-405a-b569-405125ffa3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:02.529857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b59a70-1a49-405a-b569-405125ffa3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:02.530301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b59a70-1a49-405a-b569-405125ffa3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:02.530721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3b59a70-1a49-405a-b569-405125ffa3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:02.561092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f3b59a70-1a49-405a-b569-405125ffa3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Aug 22 19:37:02.561665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 702/1263] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:03.481655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59bc145a-9bdd-4649-9f44-156e011d1a4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:03.483906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-59bc145a-9bdd-4649-9f44-156e011d1a4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:03.490532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bc145a-9bdd-4649-9f44-156e011d1a4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:03.491026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bc145a-9bdd-4649-9f44-156e011d1a4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:03.491462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bc145a-9bdd-4649-9f44-156e011d1a4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:03.492196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bc145a-9bdd-4649-9f44-156e011d1a4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:03.492657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bc145a-9bdd-4649-9f44-156e011d1a4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:03.493081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59bc145a-9bdd-4649-9f44-156e011d1a4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:03.523781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-59bc145a-9bdd-4649-9f44-156e011d1a4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Aug 22 19:37:03.524371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 562/1264] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:03 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:03.573919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eaa052fb-7bc8-4529-8fa9-6e0a59dccb0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:03.576269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eaa052fb-7bc8-4529-8fa9-6e0a59dccb0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:03.582758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa052fb-7bc8-4529-8fa9-6e0a59dccb0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:03.583240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa052fb-7bc8-4529-8fa9-6e0a59dccb0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:03.583696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa052fb-7bc8-4529-8fa9-6e0a59dccb0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:03.584986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa052fb-7bc8-4529-8fa9-6e0a59dccb0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:03.585881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa052fb-7bc8-4529-8fa9-6e0a59dccb0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:03.585881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa052fb-7bc8-4529-8fa9-6e0a59dccb0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:03.615944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eaa052fb-7bc8-4529-8fa9-6e0a59dccb0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Aug 22 19:37:03.616519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 703/1265] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:04.536183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c814d77-7eae-4536-a540-1ff9b0f60a34 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:04.538941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c814d77-7eae-4536-a540-1ff9b0f60a34 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:04.545786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814d77-7eae-4536-a540-1ff9b0f60a34 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:04.546279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814d77-7eae-4536-a540-1ff9b0f60a34 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:04.546522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814d77-7eae-4536-a540-1ff9b0f60a34 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:04.547221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814d77-7eae-4536-a540-1ff9b0f60a34 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:04.547689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814d77-7eae-4536-a540-1ff9b0f60a34 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:04.548111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c814d77-7eae-4536-a540-1ff9b0f60a34 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:04.579803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c814d77-7eae-4536-a540-1ff9b0f60a34 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047378 Aug 22 19:37:04.580337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 563/1266] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:04 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:04.627948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a268f270-2c14-485d-8540-a169d24152e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:04.630150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a268f270-2c14-485d-8540-a169d24152e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:04.636817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a268f270-2c14-485d-8540-a169d24152e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:04.637388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a268f270-2c14-485d-8540-a169d24152e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:04.637832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a268f270-2c14-485d-8540-a169d24152e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:04.638540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a268f270-2c14-485d-8540-a169d24152e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:04.638995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a268f270-2c14-485d-8540-a169d24152e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:04.639429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a268f270-2c14-485d-8540-a169d24152e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:04.670689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a268f270-2c14-485d-8540-a169d24152e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046655 Aug 22 19:37:04.671269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 704/1267] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:05.592160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6166f4cc-b702-4181-be25-69c7d6c22352 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:05.594402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6166f4cc-b702-4181-be25-69c7d6c22352 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:05.601028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6166f4cc-b702-4181-be25-69c7d6c22352 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:05.601511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6166f4cc-b702-4181-be25-69c7d6c22352 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:05.601945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6166f4cc-b702-4181-be25-69c7d6c22352 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:05.602653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6166f4cc-b702-4181-be25-69c7d6c22352 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:05.603109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6166f4cc-b702-4181-be25-69c7d6c22352 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:05.603530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6166f4cc-b702-4181-be25-69c7d6c22352 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:05.634429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6166f4cc-b702-4181-be25-69c7d6c22352 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Aug 22 19:37:05.635011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 564/1268] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:05 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:05.683147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dc35be4d-2937-468f-a124-13743528bde4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:05.685374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dc35be4d-2937-468f-a124-13743528bde4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:05.692081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc35be4d-2937-468f-a124-13743528bde4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:05.692588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc35be4d-2937-468f-a124-13743528bde4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:05.693011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc35be4d-2937-468f-a124-13743528bde4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:05.694335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc35be4d-2937-468f-a124-13743528bde4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:05.694786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc35be4d-2937-468f-a124-13743528bde4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:05.695213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc35be4d-2937-468f-a124-13743528bde4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:05.725258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dc35be4d-2937-468f-a124-13743528bde4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Aug 22 19:37:05.725826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 705/1269] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:06.646243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-910be4ad-8c7a-4278-819a-a016f0ab59ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:06.649056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-910be4ad-8c7a-4278-819a-a016f0ab59ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:06.655518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-910be4ad-8c7a-4278-819a-a016f0ab59ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:06.656039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-910be4ad-8c7a-4278-819a-a016f0ab59ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:06.656470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-910be4ad-8c7a-4278-819a-a016f0ab59ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:06.657183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-910be4ad-8c7a-4278-819a-a016f0ab59ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:06.657635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-910be4ad-8c7a-4278-819a-a016f0ab59ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:06.658055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-910be4ad-8c7a-4278-819a-a016f0ab59ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:06.692015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-910be4ad-8c7a-4278-819a-a016f0ab59ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047940 Aug 22 19:37:06.692015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 565/1270] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:06 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:06.737891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-614c29a2-feb2-491c-bddf-f5a860328cb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:06.740078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-614c29a2-feb2-491c-bddf-f5a860328cb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:06.746702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614c29a2-feb2-491c-bddf-f5a860328cb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:06.747184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614c29a2-feb2-491c-bddf-f5a860328cb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:06.747612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614c29a2-feb2-491c-bddf-f5a860328cb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:06.748373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614c29a2-feb2-491c-bddf-f5a860328cb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:06.748785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614c29a2-feb2-491c-bddf-f5a860328cb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:06.749202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-614c29a2-feb2-491c-bddf-f5a860328cb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:06.784884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-614c29a2-feb2-491c-bddf-f5a860328cb2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050845 Aug 22 19:37:06.785457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 706/1271] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:07.702976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3cb0a59-a8e8-4767-9f01-c8afcba366eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:07.705207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3cb0a59-a8e8-4767-9f01-c8afcba366eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:07.711749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3cb0a59-a8e8-4767-9f01-c8afcba366eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:07.712488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3cb0a59-a8e8-4767-9f01-c8afcba366eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:07.712918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3cb0a59-a8e8-4767-9f01-c8afcba366eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:07.713605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3cb0a59-a8e8-4767-9f01-c8afcba366eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:07.714051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3cb0a59-a8e8-4767-9f01-c8afcba366eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:07.714466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3cb0a59-a8e8-4767-9f01-c8afcba366eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:07.745089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3cb0a59-a8e8-4767-9f01-c8afcba366eb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Aug 22 19:37:07.745774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 566/1272] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:07 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:07.797137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cfd13276-dc00-4d59-9b11-ee84170b0f26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:07.799270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cfd13276-dc00-4d59-9b11-ee84170b0f26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:07.806496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfd13276-dc00-4d59-9b11-ee84170b0f26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:07.806973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfd13276-dc00-4d59-9b11-ee84170b0f26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:07.807403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfd13276-dc00-4d59-9b11-ee84170b0f26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:07.808120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfd13276-dc00-4d59-9b11-ee84170b0f26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:07.808583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfd13276-dc00-4d59-9b11-ee84170b0f26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:07.808992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cfd13276-dc00-4d59-9b11-ee84170b0f26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:07.839853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cfd13276-dc00-4d59-9b11-ee84170b0f26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046476 Aug 22 19:37:07.840434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 707/1273] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:08.758929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b65eb70c-38d9-49a9-935a-2814dce234c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:08.761150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b65eb70c-38d9-49a9-935a-2814dce234c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:08.767991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65eb70c-38d9-49a9-935a-2814dce234c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:08.768468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65eb70c-38d9-49a9-935a-2814dce234c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:08.768899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65eb70c-38d9-49a9-935a-2814dce234c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:08.769596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65eb70c-38d9-49a9-935a-2814dce234c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:08.770045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65eb70c-38d9-49a9-935a-2814dce234c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:08.770455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b65eb70c-38d9-49a9-935a-2814dce234c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:08.800654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b65eb70c-38d9-49a9-935a-2814dce234c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046301 Aug 22 19:37:08.801220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 567/1274] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:08 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:08.852431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6a400627-4668-4da4-bfc3-ad85150a979e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:08.854598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6a400627-4668-4da4-bfc3-ad85150a979e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:08.861309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a400627-4668-4da4-bfc3-ad85150a979e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:08.861806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a400627-4668-4da4-bfc3-ad85150a979e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:08.862240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a400627-4668-4da4-bfc3-ad85150a979e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:08.862941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a400627-4668-4da4-bfc3-ad85150a979e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:08.863392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a400627-4668-4da4-bfc3-ad85150a979e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:08.863849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6a400627-4668-4da4-bfc3-ad85150a979e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:08.896300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6a400627-4668-4da4-bfc3-ad85150a979e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048216 Aug 22 19:37:08.896873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 708/1275] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:09.814216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8bc5aa34-98b6-48a3-9a8e-9b839529c060 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:09.816322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8bc5aa34-98b6-48a3-9a8e-9b839529c060 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:09.822659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bc5aa34-98b6-48a3-9a8e-9b839529c060 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:09.823170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bc5aa34-98b6-48a3-9a8e-9b839529c060 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:09.823602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bc5aa34-98b6-48a3-9a8e-9b839529c060 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:09.824318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bc5aa34-98b6-48a3-9a8e-9b839529c060 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:09.824770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bc5aa34-98b6-48a3-9a8e-9b839529c060 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:09.825192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8bc5aa34-98b6-48a3-9a8e-9b839529c060 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:09.855307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8bc5aa34-98b6-48a3-9a8e-9b839529c060 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Aug 22 19:37:09.855918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 568/1276] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:09 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:09.908585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-26f795fb-ddd1-4dcc-bc13-a2faa07e1649 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:09.910705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-26f795fb-ddd1-4dcc-bc13-a2faa07e1649 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:09.917762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26f795fb-ddd1-4dcc-bc13-a2faa07e1649 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:09.918249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26f795fb-ddd1-4dcc-bc13-a2faa07e1649 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:09.918677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26f795fb-ddd1-4dcc-bc13-a2faa07e1649 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:09.919367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26f795fb-ddd1-4dcc-bc13-a2faa07e1649 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:09.919847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26f795fb-ddd1-4dcc-bc13-a2faa07e1649 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:09.920273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26f795fb-ddd1-4dcc-bc13-a2faa07e1649 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:09.949082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-26f795fb-ddd1-4dcc-bc13-a2faa07e1649 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 Aug 22 19:37:09.949651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 709/1277] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:09 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:10.868261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30f72c1b-39f3-446f-b949-fc4bb5458c0c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:10.870458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30f72c1b-39f3-446f-b949-fc4bb5458c0c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:10.877049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30f72c1b-39f3-446f-b949-fc4bb5458c0c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:10.877531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30f72c1b-39f3-446f-b949-fc4bb5458c0c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:10.877967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30f72c1b-39f3-446f-b949-fc4bb5458c0c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:10.878702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30f72c1b-39f3-446f-b949-fc4bb5458c0c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:10.879153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30f72c1b-39f3-446f-b949-fc4bb5458c0c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:10.879575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30f72c1b-39f3-446f-b949-fc4bb5458c0c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:10.910117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30f72c1b-39f3-446f-b949-fc4bb5458c0c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046266 Aug 22 19:37:10.910689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 569/1278] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:10.962405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-14bfe790-1d23-4f11-80d3-c1670ea625dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:10.964798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-14bfe790-1d23-4f11-80d3-c1670ea625dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:10.971871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14bfe790-1d23-4f11-80d3-c1670ea625dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:10.972376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14bfe790-1d23-4f11-80d3-c1670ea625dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:10.972816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14bfe790-1d23-4f11-80d3-c1670ea625dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:10.973548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14bfe790-1d23-4f11-80d3-c1670ea625dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:10.974005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14bfe790-1d23-4f11-80d3-c1670ea625dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:10.974425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14bfe790-1d23-4f11-80d3-c1670ea625dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:11.008226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-14bfe790-1d23-4f11-80d3-c1670ea625dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050619 Aug 22 19:37:11.008817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 710/1279] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:11.922461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88301a01-0938-4b9f-b1ec-d7bb345845c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:11.924703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88301a01-0938-4b9f-b1ec-d7bb345845c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:11.931304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88301a01-0938-4b9f-b1ec-d7bb345845c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:11.931809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88301a01-0938-4b9f-b1ec-d7bb345845c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:11.932245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88301a01-0938-4b9f-b1ec-d7bb345845c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:11.932951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88301a01-0938-4b9f-b1ec-d7bb345845c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:11.933400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88301a01-0938-4b9f-b1ec-d7bb345845c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:11.933826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88301a01-0938-4b9f-b1ec-d7bb345845c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:11.964675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88301a01-0938-4b9f-b1ec-d7bb345845c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Aug 22 19:37:11.965453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 570/1280] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:11 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:12.020340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4a7557e9-8ee9-4900-b3ce-22c1479dcd55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:12.023204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4a7557e9-8ee9-4900-b3ce-22c1479dcd55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:12.029849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a7557e9-8ee9-4900-b3ce-22c1479dcd55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:12.030337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a7557e9-8ee9-4900-b3ce-22c1479dcd55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:12.030773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a7557e9-8ee9-4900-b3ce-22c1479dcd55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:12.031481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a7557e9-8ee9-4900-b3ce-22c1479dcd55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:12.031969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a7557e9-8ee9-4900-b3ce-22c1479dcd55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:12.032397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a7557e9-8ee9-4900-b3ce-22c1479dcd55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:12.063189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4a7557e9-8ee9-4900-b3ce-22c1479dcd55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046865 Aug 22 19:37:12.063791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 711/1281] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:37:12.977118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-680535ca-7910-4687-9d4d-a3759c42a89b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:12.979266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-680535ca-7910-4687-9d4d-a3759c42a89b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:12.985780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-680535ca-7910-4687-9d4d-a3759c42a89b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:12.986263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-680535ca-7910-4687-9d4d-a3759c42a89b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:12.986696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-680535ca-7910-4687-9d4d-a3759c42a89b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:12.987447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-680535ca-7910-4687-9d4d-a3759c42a89b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:12.987888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-680535ca-7910-4687-9d4d-a3759c42a89b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:12.988311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-680535ca-7910-4687-9d4d-a3759c42a89b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:13.018898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-680535ca-7910-4687-9d4d-a3759c42a89b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045757 Aug 22 19:37:13.019466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 571/1282] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:12 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:37:13.075772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ea210fee-96d6-403b-960b-da5094c61535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:13.077976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ea210fee-96d6-403b-960b-da5094c61535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:13.085369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea210fee-96d6-403b-960b-da5094c61535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:13.085862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea210fee-96d6-403b-960b-da5094c61535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:13.086301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea210fee-96d6-403b-960b-da5094c61535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:13.087292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea210fee-96d6-403b-960b-da5094c61535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:13.087789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea210fee-96d6-403b-960b-da5094c61535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:13.088212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea210fee-96d6-403b-960b-da5094c61535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:13.122669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ea210fee-96d6-403b-960b-da5094c61535 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050805 Aug 22 19:37:13.123242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 712/1283] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:14.031288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fed9b647-880b-4f62-b531-37c1b14ba967 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:14.033476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fed9b647-880b-4f62-b531-37c1b14ba967 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:14.035833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=58 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:14.041865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fed9b647-880b-4f62-b531-37c1b14ba967 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:14.042350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fed9b647-880b-4f62-b531-37c1b14ba967 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:14.042805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fed9b647-880b-4f62-b531-37c1b14ba967 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:14.043490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fed9b647-880b-4f62-b531-37c1b14ba967 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:14.043972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fed9b647-880b-4f62-b531-37c1b14ba967 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:14.044396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fed9b647-880b-4f62-b531-37c1b14ba967 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:14.074579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fed9b647-880b-4f62-b531-37c1b14ba967 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047185 Aug 22 19:37:14.075149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 572/1284] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:14.135399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-56c25326-1971-413b-a528-f8040c2e1f0e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:14.137621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-56c25326-1971-413b-a528-f8040c2e1f0e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:14.140046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=58 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:14.148972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56c25326-1971-413b-a528-f8040c2e1f0e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:14.149489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56c25326-1971-413b-a528-f8040c2e1f0e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:14.149923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56c25326-1971-413b-a528-f8040c2e1f0e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:14.150835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56c25326-1971-413b-a528-f8040c2e1f0e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:14.151287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56c25326-1971-413b-a528-f8040c2e1f0e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:14.151833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56c25326-1971-413b-a528-f8040c2e1f0e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:14.185702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-56c25326-1971-413b-a528-f8040c2e1f0e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054991 Aug 22 19:37:14.186293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 713/1285] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:15.087887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e2d4165-d865-4528-9c33-3ca27591491d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:15.090009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e2d4165-d865-4528-9c33-3ca27591491d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:15.096728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e2d4165-d865-4528-9c33-3ca27591491d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:15.097212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e2d4165-d865-4528-9c33-3ca27591491d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:15.097642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e2d4165-d865-4528-9c33-3ca27591491d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:15.098337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e2d4165-d865-4528-9c33-3ca27591491d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:15.098782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e2d4165-d865-4528-9c33-3ca27591491d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:15.099201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e2d4165-d865-4528-9c33-3ca27591491d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:15.129361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e2d4165-d865-4528-9c33-3ca27591491d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046272 Aug 22 19:37:15.129934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 573/1286] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:15.198661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-55dacbfa-888d-4554-9047-89b4e0c12edd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:15.200609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-55dacbfa-888d-4554-9047-89b4e0c12edd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:15.206761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55dacbfa-888d-4554-9047-89b4e0c12edd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:15.207247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55dacbfa-888d-4554-9047-89b4e0c12edd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:15.207701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55dacbfa-888d-4554-9047-89b4e0c12edd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:15.208408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55dacbfa-888d-4554-9047-89b4e0c12edd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:15.208965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55dacbfa-888d-4554-9047-89b4e0c12edd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:15.209393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55dacbfa-888d-4554-9047-89b4e0c12edd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:15.240516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-55dacbfa-888d-4554-9047-89b4e0c12edd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Aug 22 19:37:15.241101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 714/1287] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:15 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:16.142208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2cdf5b1c-cc9d-4aa8-993b-0cc75ec4f512 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:16.144431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2cdf5b1c-cc9d-4aa8-993b-0cc75ec4f512 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:16.151549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cdf5b1c-cc9d-4aa8-993b-0cc75ec4f512 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:16.152065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cdf5b1c-cc9d-4aa8-993b-0cc75ec4f512 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:16.152499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cdf5b1c-cc9d-4aa8-993b-0cc75ec4f512 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:16.153206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cdf5b1c-cc9d-4aa8-993b-0cc75ec4f512 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:16.153662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cdf5b1c-cc9d-4aa8-993b-0cc75ec4f512 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:16.154089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cdf5b1c-cc9d-4aa8-993b-0cc75ec4f512 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:16.184363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2cdf5b1c-cc9d-4aa8-993b-0cc75ec4f512 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046071 Aug 22 19:37:16.184960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 574/1288] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:16 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:16.253171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ab046b5b-e627-4f90-a393-df45c70bdf0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:16.255312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ab046b5b-e627-4f90-a393-df45c70bdf0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:16.262447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab046b5b-e627-4f90-a393-df45c70bdf0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:16.262932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab046b5b-e627-4f90-a393-df45c70bdf0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:16.263363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab046b5b-e627-4f90-a393-df45c70bdf0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:16.264097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab046b5b-e627-4f90-a393-df45c70bdf0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:16.264544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab046b5b-e627-4f90-a393-df45c70bdf0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:16.265014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab046b5b-e627-4f90-a393-df45c70bdf0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:16.293254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:16.299768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ab046b5b-e627-4f90-a393-df45c70bdf0c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050693 Aug 22 19:37:16.300344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 715/1289] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:17.197229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f80f279-93d8-4a0e-85c4-bdf6fef0c118 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:17.199478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f80f279-93d8-4a0e-85c4-bdf6fef0c118 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:17.206037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f80f279-93d8-4a0e-85c4-bdf6fef0c118 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:17.206519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f80f279-93d8-4a0e-85c4-bdf6fef0c118 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:17.206956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f80f279-93d8-4a0e-85c4-bdf6fef0c118 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:17.207676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f80f279-93d8-4a0e-85c4-bdf6fef0c118 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:17.208134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f80f279-93d8-4a0e-85c4-bdf6fef0c118 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:17.208555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f80f279-93d8-4a0e-85c4-bdf6fef0c118 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:17.213287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:17.239940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f80f279-93d8-4a0e-85c4-bdf6fef0c118 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047103 Aug 22 19:37:17.240529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 575/1290] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:17 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:17.315202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-46cd3a8d-1000-48d5-9f0b-dc849e253449 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:17.319066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-46cd3a8d-1000-48d5-9f0b-dc849e253449 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:17.328650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46cd3a8d-1000-48d5-9f0b-dc849e253449 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:17.329257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46cd3a8d-1000-48d5-9f0b-dc849e253449 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:17.329965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46cd3a8d-1000-48d5-9f0b-dc849e253449 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:17.331099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46cd3a8d-1000-48d5-9f0b-dc849e253449 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:17.331894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46cd3a8d-1000-48d5-9f0b-dc849e253449 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:17.332581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46cd3a8d-1000-48d5-9f0b-dc849e253449 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:17.371099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-46cd3a8d-1000-48d5-9f0b-dc849e253449 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062603 Aug 22 19:37:17.371711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 716/1291] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:18.252287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa6a639f-8ace-4b57-8af6-345707b7f149 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:18.254408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa6a639f-8ace-4b57-8af6-345707b7f149 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:18.261033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa6a639f-8ace-4b57-8af6-345707b7f149 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:18.261639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa6a639f-8ace-4b57-8af6-345707b7f149 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:18.262171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa6a639f-8ace-4b57-8af6-345707b7f149 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:18.262876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa6a639f-8ace-4b57-8af6-345707b7f149 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:18.263363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa6a639f-8ace-4b57-8af6-345707b7f149 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:18.263825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa6a639f-8ace-4b57-8af6-345707b7f149 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:18.294542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa6a639f-8ace-4b57-8af6-345707b7f149 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046117 Aug 22 19:37:18.295119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 576/1292] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:18 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:18.384519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ec5b3f5c-690a-4fb6-9606-ab90c0918666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:18.386732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ec5b3f5c-690a-4fb6-9606-ab90c0918666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:18.393984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec5b3f5c-690a-4fb6-9606-ab90c0918666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:18.394638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec5b3f5c-690a-4fb6-9606-ab90c0918666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:18.395127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec5b3f5c-690a-4fb6-9606-ab90c0918666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:18.395905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec5b3f5c-690a-4fb6-9606-ab90c0918666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:18.396990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec5b3f5c-690a-4fb6-9606-ab90c0918666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:18.397429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec5b3f5c-690a-4fb6-9606-ab90c0918666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:18.432183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ec5b3f5c-690a-4fb6-9606-ab90c0918666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053555 Aug 22 19:37:18.432891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 717/1293] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:19.306161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-323ec428-7f8b-476e-a7a4-5b28550b0c4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:19.308359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-323ec428-7f8b-476e-a7a4-5b28550b0c4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:19.315735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-323ec428-7f8b-476e-a7a4-5b28550b0c4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:19.316223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-323ec428-7f8b-476e-a7a4-5b28550b0c4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:19.316658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-323ec428-7f8b-476e-a7a4-5b28550b0c4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:19.317361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-323ec428-7f8b-476e-a7a4-5b28550b0c4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:19.317811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-323ec428-7f8b-476e-a7a4-5b28550b0c4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:19.318234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-323ec428-7f8b-476e-a7a4-5b28550b0c4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:19.357095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-323ec428-7f8b-476e-a7a4-5b28550b0c4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054860 Aug 22 19:37:19.357703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 577/1294] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:37:19.444509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d0b3eb74-f0d0-4b61-9086-101ec31d430f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:19.446734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d0b3eb74-f0d0-4b61-9086-101ec31d430f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:19.453431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b3eb74-f0d0-4b61-9086-101ec31d430f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:19.453921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b3eb74-f0d0-4b61-9086-101ec31d430f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:19.454348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b3eb74-f0d0-4b61-9086-101ec31d430f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:19.455063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b3eb74-f0d0-4b61-9086-101ec31d430f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:19.455506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b3eb74-f0d0-4b61-9086-101ec31d430f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:19.455949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0b3eb74-f0d0-4b61-9086-101ec31d430f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:19.486922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d0b3eb74-f0d0-4b61-9086-101ec31d430f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046421 Aug 22 19:37:19.487502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 718/1295] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:20.369490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae4a2345-63a8-4c29-ac7c-132e54b4e2dc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:20.371613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae4a2345-63a8-4c29-ac7c-132e54b4e2dc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:20.378300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4a2345-63a8-4c29-ac7c-132e54b4e2dc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:20.378939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4a2345-63a8-4c29-ac7c-132e54b4e2dc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:20.379380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4a2345-63a8-4c29-ac7c-132e54b4e2dc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:20.380480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4a2345-63a8-4c29-ac7c-132e54b4e2dc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:20.381165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4a2345-63a8-4c29-ac7c-132e54b4e2dc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:20.381593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4a2345-63a8-4c29-ac7c-132e54b4e2dc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:20.412367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae4a2345-63a8-4c29-ac7c-132e54b4e2dc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046654 Aug 22 19:37:20.412846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 578/1296] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:20 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:20.500146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0a07b805-bf7b-4a99-a958-c2320e1cf29d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:20.502340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0a07b805-bf7b-4a99-a958-c2320e1cf29d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:20.509986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a07b805-bf7b-4a99-a958-c2320e1cf29d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:20.510455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a07b805-bf7b-4a99-a958-c2320e1cf29d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:20.510884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a07b805-bf7b-4a99-a958-c2320e1cf29d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:20.511725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a07b805-bf7b-4a99-a958-c2320e1cf29d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:20.512049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a07b805-bf7b-4a99-a958-c2320e1cf29d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:20.512469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a07b805-bf7b-4a99-a958-c2320e1cf29d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:20.542146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0a07b805-bf7b-4a99-a958-c2320e1cf29d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046018 Aug 22 19:37:20.542725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 719/1297] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:37:21.424658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2275bb6b-fd81-4f4e-abd3-b262f446889b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:21.426706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2275bb6b-fd81-4f4e-abd3-b262f446889b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:21.433776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2275bb6b-fd81-4f4e-abd3-b262f446889b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:21.434263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2275bb6b-fd81-4f4e-abd3-b262f446889b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:21.434705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2275bb6b-fd81-4f4e-abd3-b262f446889b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:21.435413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2275bb6b-fd81-4f4e-abd3-b262f446889b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:21.435905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2275bb6b-fd81-4f4e-abd3-b262f446889b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:21.436331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2275bb6b-fd81-4f4e-abd3-b262f446889b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:21.467363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2275bb6b-fd81-4f4e-abd3-b262f446889b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046653 Aug 22 19:37:21.468041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 579/1298] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:21 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:21.554637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-38d16d01-6ddf-4d82-9c0c-63646d907e26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:21.556799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-38d16d01-6ddf-4d82-9c0c-63646d907e26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:21.563518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38d16d01-6ddf-4d82-9c0c-63646d907e26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:21.564045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38d16d01-6ddf-4d82-9c0c-63646d907e26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:21.564477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38d16d01-6ddf-4d82-9c0c-63646d907e26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:21.565180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38d16d01-6ddf-4d82-9c0c-63646d907e26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:21.565625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38d16d01-6ddf-4d82-9c0c-63646d907e26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:21.566040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38d16d01-6ddf-4d82-9c0c-63646d907e26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:21.597207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-38d16d01-6ddf-4d82-9c0c-63646d907e26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046561 Aug 22 19:37:21.597778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 720/1299] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:22.480242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-722e35bc-4cdc-4786-978d-3617f6f71030 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:22.482347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-722e35bc-4cdc-4786-978d-3617f6f71030 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:22.488799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-722e35bc-4cdc-4786-978d-3617f6f71030 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:22.489277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-722e35bc-4cdc-4786-978d-3617f6f71030 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:22.489703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-722e35bc-4cdc-4786-978d-3617f6f71030 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:22.491059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-722e35bc-4cdc-4786-978d-3617f6f71030 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:22.491506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-722e35bc-4cdc-4786-978d-3617f6f71030 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:22.491955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-722e35bc-4cdc-4786-978d-3617f6f71030 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:22.521993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-722e35bc-4cdc-4786-978d-3617f6f71030 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Aug 22 19:37:22.522648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 580/1300] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:22 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:22.609587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0c3c6f7f-e7cb-4cce-8f50-566c581d4030 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:22.611682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0c3c6f7f-e7cb-4cce-8f50-566c581d4030 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:22.618874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c3c6f7f-e7cb-4cce-8f50-566c581d4030 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:22.619366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c3c6f7f-e7cb-4cce-8f50-566c581d4030 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:22.619848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c3c6f7f-e7cb-4cce-8f50-566c581d4030 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:22.620587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c3c6f7f-e7cb-4cce-8f50-566c581d4030 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:22.621043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c3c6f7f-e7cb-4cce-8f50-566c581d4030 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:22.621466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c3c6f7f-e7cb-4cce-8f50-566c581d4030 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:22.653465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0c3c6f7f-e7cb-4cce-8f50-566c581d4030 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047987 Aug 22 19:37:22.654054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 721/1301] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:23.534674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bc9555d8-be49-4644-8c29-57b7b86fcb7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:23.536957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bc9555d8-be49-4644-8c29-57b7b86fcb7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:23.544031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9555d8-be49-4644-8c29-57b7b86fcb7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:23.544514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9555d8-be49-4644-8c29-57b7b86fcb7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:23.544949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9555d8-be49-4644-8c29-57b7b86fcb7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:23.545648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9555d8-be49-4644-8c29-57b7b86fcb7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:23.546100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9555d8-be49-4644-8c29-57b7b86fcb7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:23.546526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bc9555d8-be49-4644-8c29-57b7b86fcb7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:23.577426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bc9555d8-be49-4644-8c29-57b7b86fcb7b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046611 Aug 22 19:37:23.577907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 581/1302] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:23 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:23.665803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-39ed3ece-b771-435d-8af7-44378bf0a945 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:23.667948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-39ed3ece-b771-435d-8af7-44378bf0a945 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:23.674547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39ed3ece-b771-435d-8af7-44378bf0a945 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:23.675026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39ed3ece-b771-435d-8af7-44378bf0a945 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:23.675457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39ed3ece-b771-435d-8af7-44378bf0a945 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:23.676200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39ed3ece-b771-435d-8af7-44378bf0a945 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:23.676645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39ed3ece-b771-435d-8af7-44378bf0a945 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:23.677064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-39ed3ece-b771-435d-8af7-44378bf0a945 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:23.707720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-39ed3ece-b771-435d-8af7-44378bf0a945 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045784 Aug 22 19:37:23.708296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 722/1303] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:24.589930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e62e3856-9e93-4c28-91ac-a2ef2bfea931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:24.592091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e62e3856-9e93-4c28-91ac-a2ef2bfea931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:24.598552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e3856-9e93-4c28-91ac-a2ef2bfea931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:24.599034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e3856-9e93-4c28-91ac-a2ef2bfea931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:24.600089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e3856-9e93-4c28-91ac-a2ef2bfea931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:24.600700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e3856-9e93-4c28-91ac-a2ef2bfea931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:24.601149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e3856-9e93-4c28-91ac-a2ef2bfea931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:24.601572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e3856-9e93-4c28-91ac-a2ef2bfea931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:24.631351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e62e3856-9e93-4c28-91ac-a2ef2bfea931 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045590 Aug 22 19:37:24.631950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 582/1304] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:24.720877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a183e72d-6627-4f0c-9acc-8d8fd2714f61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:24.722957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a183e72d-6627-4f0c-9acc-8d8fd2714f61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:24.729862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a183e72d-6627-4f0c-9acc-8d8fd2714f61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:24.730271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a183e72d-6627-4f0c-9acc-8d8fd2714f61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:24.730713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a183e72d-6627-4f0c-9acc-8d8fd2714f61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:24.731432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a183e72d-6627-4f0c-9acc-8d8fd2714f61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:24.731929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a183e72d-6627-4f0c-9acc-8d8fd2714f61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:24.732393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a183e72d-6627-4f0c-9acc-8d8fd2714f61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:24.763225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a183e72d-6627-4f0c-9acc-8d8fd2714f61 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046329 Aug 22 19:37:24.763832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 723/1305] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:25.643617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f6a07e9-2b12-47e6-886a-e855d5cf03ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:25.645781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f6a07e9-2b12-47e6-886a-e855d5cf03ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:25.652809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f6a07e9-2b12-47e6-886a-e855d5cf03ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:25.653291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f6a07e9-2b12-47e6-886a-e855d5cf03ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:25.653725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f6a07e9-2b12-47e6-886a-e855d5cf03ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:25.654426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f6a07e9-2b12-47e6-886a-e855d5cf03ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:25.654877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f6a07e9-2b12-47e6-886a-e855d5cf03ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:25.655297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f6a07e9-2b12-47e6-886a-e855d5cf03ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:25.685122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f6a07e9-2b12-47e6-886a-e855d5cf03ad tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Aug 22 19:37:25.685694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 583/1306] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:25 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:25.776408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ba39641b-16d4-45aa-9ca5-83157c7eee59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:25.778561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ba39641b-16d4-45aa-9ca5-83157c7eee59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:25.785131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ba39641b-16d4-45aa-9ca5-83157c7eee59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:25.785617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ba39641b-16d4-45aa-9ca5-83157c7eee59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:25.786050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ba39641b-16d4-45aa-9ca5-83157c7eee59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:25.786757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ba39641b-16d4-45aa-9ca5-83157c7eee59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:25.787880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ba39641b-16d4-45aa-9ca5-83157c7eee59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:25.788308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ba39641b-16d4-45aa-9ca5-83157c7eee59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:25.817764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ba39641b-16d4-45aa-9ca5-83157c7eee59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045426 Aug 22 19:37:25.818357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 724/1307] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:26.698406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51c295d6-4094-40c0-b270-b3510acf5036 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:26.700667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51c295d6-4094-40c0-b270-b3510acf5036 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:26.707036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c295d6-4094-40c0-b270-b3510acf5036 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:26.707519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c295d6-4094-40c0-b270-b3510acf5036 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:26.707988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c295d6-4094-40c0-b270-b3510acf5036 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:26.709232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c295d6-4094-40c0-b270-b3510acf5036 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:26.709678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c295d6-4094-40c0-b270-b3510acf5036 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:26.710095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c295d6-4094-40c0-b270-b3510acf5036 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:26.741820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51c295d6-4094-40c0-b270-b3510acf5036 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047732 Aug 22 19:37:26.742389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 584/1308] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:26 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:26.830274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-68b5e411-7e77-4fde-9780-9d2be638c1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:26.832388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-68b5e411-7e77-4fde-9780-9d2be638c1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:26.840095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68b5e411-7e77-4fde-9780-9d2be638c1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:26.840725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68b5e411-7e77-4fde-9780-9d2be638c1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:26.841165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68b5e411-7e77-4fde-9780-9d2be638c1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:26.841877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68b5e411-7e77-4fde-9780-9d2be638c1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:26.842334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68b5e411-7e77-4fde-9780-9d2be638c1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:26.842761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68b5e411-7e77-4fde-9780-9d2be638c1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:26.873907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-68b5e411-7e77-4fde-9780-9d2be638c1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047641 Aug 22 19:37:26.874507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 725/1309] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:27.754420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96b5e1a5-775e-46f5-a7e9-5d0e16e3aca4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:27.757134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96b5e1a5-775e-46f5-a7e9-5d0e16e3aca4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:27.764113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b5e1a5-775e-46f5-a7e9-5d0e16e3aca4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:27.764591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b5e1a5-775e-46f5-a7e9-5d0e16e3aca4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:27.765231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b5e1a5-775e-46f5-a7e9-5d0e16e3aca4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:27.766005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b5e1a5-775e-46f5-a7e9-5d0e16e3aca4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:27.766453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b5e1a5-775e-46f5-a7e9-5d0e16e3aca4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:27.766871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b5e1a5-775e-46f5-a7e9-5d0e16e3aca4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:27.798036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96b5e1a5-775e-46f5-a7e9-5d0e16e3aca4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Aug 22 19:37:27.798600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 585/1310] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:27.886993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c0ef6b10-1f92-4c1c-89a2-1a778f1de7ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:27.889628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c0ef6b10-1f92-4c1c-89a2-1a778f1de7ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:27.896894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0ef6b10-1f92-4c1c-89a2-1a778f1de7ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:27.897381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0ef6b10-1f92-4c1c-89a2-1a778f1de7ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:27.897815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0ef6b10-1f92-4c1c-89a2-1a778f1de7ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:27.898525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0ef6b10-1f92-4c1c-89a2-1a778f1de7ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:27.898979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0ef6b10-1f92-4c1c-89a2-1a778f1de7ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:27.899405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c0ef6b10-1f92-4c1c-89a2-1a778f1de7ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:27.929846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c0ef6b10-1f92-4c1c-89a2-1a778f1de7ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046889 Aug 22 19:37:27.930444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 726/1311] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:27 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:28.811254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a34171cf-2674-46e1-9100-029d9f53d3f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:28.813473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a34171cf-2674-46e1-9100-029d9f53d3f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:28.823836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34171cf-2674-46e1-9100-029d9f53d3f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:28.824403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34171cf-2674-46e1-9100-029d9f53d3f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:28.824948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34171cf-2674-46e1-9100-029d9f53d3f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:28.825802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34171cf-2674-46e1-9100-029d9f53d3f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:28.826374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34171cf-2674-46e1-9100-029d9f53d3f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:28.827632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a34171cf-2674-46e1-9100-029d9f53d3f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:28.857646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a34171cf-2674-46e1-9100-029d9f53d3f8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050456 Aug 22 19:37:28.858215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 586/1312] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:28 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:28.942671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b7d75ba-c216-4d2c-8f6d-d188d6118139 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:28.945325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b7d75ba-c216-4d2c-8f6d-d188d6118139 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:28.951776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b7d75ba-c216-4d2c-8f6d-d188d6118139 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:28.952257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b7d75ba-c216-4d2c-8f6d-d188d6118139 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:28.952687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b7d75ba-c216-4d2c-8f6d-d188d6118139 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:28.953379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b7d75ba-c216-4d2c-8f6d-d188d6118139 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:28.953825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b7d75ba-c216-4d2c-8f6d-d188d6118139 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:28.954244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b7d75ba-c216-4d2c-8f6d-d188d6118139 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:28.983338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b7d75ba-c216-4d2c-8f6d-d188d6118139 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Aug 22 19:37:28.983942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 727/1313] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:29.869706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02a36c11-dbe8-4f87-b0ca-4b867bce38e6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:29.871834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02a36c11-dbe8-4f87-b0ca-4b867bce38e6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:29.878408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a36c11-dbe8-4f87-b0ca-4b867bce38e6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:29.878892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a36c11-dbe8-4f87-b0ca-4b867bce38e6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:29.879324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a36c11-dbe8-4f87-b0ca-4b867bce38e6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:29.880062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a36c11-dbe8-4f87-b0ca-4b867bce38e6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:29.881092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a36c11-dbe8-4f87-b0ca-4b867bce38e6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:29.881536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02a36c11-dbe8-4f87-b0ca-4b867bce38e6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:29.912007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02a36c11-dbe8-4f87-b0ca-4b867bce38e6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046230 Aug 22 19:37:29.912572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 587/1314] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:29 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:29.994764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7cad1164-a38e-4907-8608-b34a591e7860 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:29.996974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7cad1164-a38e-4907-8608-b34a591e7860 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:30.003282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cad1164-a38e-4907-8608-b34a591e7860 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:30.003809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cad1164-a38e-4907-8608-b34a591e7860 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:30.004240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cad1164-a38e-4907-8608-b34a591e7860 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:30.004926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cad1164-a38e-4907-8608-b34a591e7860 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:30.005894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cad1164-a38e-4907-8608-b34a591e7860 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:30.006314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cad1164-a38e-4907-8608-b34a591e7860 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:30.035978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7cad1164-a38e-4907-8608-b34a591e7860 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Aug 22 19:37:30.036544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 728/1315] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:29 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:30.924372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84bb6677-5f60-4003-8642-ff769652279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:30.926510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84bb6677-5f60-4003-8642-ff769652279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:30.933398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84bb6677-5f60-4003-8642-ff769652279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:30.933858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84bb6677-5f60-4003-8642-ff769652279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:30.934291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84bb6677-5f60-4003-8642-ff769652279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:30.934981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84bb6677-5f60-4003-8642-ff769652279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:30.935431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84bb6677-5f60-4003-8642-ff769652279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:30.935895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84bb6677-5f60-4003-8642-ff769652279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:30.964456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84bb6677-5f60-4003-8642-ff769652279e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Aug 22 19:37:30.964997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 588/1316] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:31.048860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b844083b-eb02-48d7-a19d-62e6235e97c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:31.051039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b844083b-eb02-48d7-a19d-62e6235e97c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:31.057859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b844083b-eb02-48d7-a19d-62e6235e97c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:31.058316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b844083b-eb02-48d7-a19d-62e6235e97c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:31.058748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b844083b-eb02-48d7-a19d-62e6235e97c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:31.059535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b844083b-eb02-48d7-a19d-62e6235e97c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:31.060014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b844083b-eb02-48d7-a19d-62e6235e97c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:31.060433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b844083b-eb02-48d7-a19d-62e6235e97c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:31.088867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b844083b-eb02-48d7-a19d-62e6235e97c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Aug 22 19:37:31.089422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 729/1317] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:31.977306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ee0572f-f883-4cd4-9199-dac47f2aded4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:31.979460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ee0572f-f883-4cd4-9199-dac47f2aded4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:31.986523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee0572f-f883-4cd4-9199-dac47f2aded4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:31.987009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee0572f-f883-4cd4-9199-dac47f2aded4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:31.987444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee0572f-f883-4cd4-9199-dac47f2aded4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:31.988184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee0572f-f883-4cd4-9199-dac47f2aded4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:31.988848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee0572f-f883-4cd4-9199-dac47f2aded4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:31.989477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee0572f-f883-4cd4-9199-dac47f2aded4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:32.019970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ee0572f-f883-4cd4-9199-dac47f2aded4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Aug 22 19:37:32.020526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 589/1318] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:32.100997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-226f2b3d-a940-47f1-961a-192903089905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:32.103161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-226f2b3d-a940-47f1-961a-192903089905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:32.109322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-226f2b3d-a940-47f1-961a-192903089905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:32.109742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-226f2b3d-a940-47f1-961a-192903089905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:32.110180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-226f2b3d-a940-47f1-961a-192903089905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:32.110874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-226f2b3d-a940-47f1-961a-192903089905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:32.111327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-226f2b3d-a940-47f1-961a-192903089905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:32.111777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-226f2b3d-a940-47f1-961a-192903089905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:32.140708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-226f2b3d-a940-47f1-961a-192903089905 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Aug 22 19:37:32.141264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 730/1319] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:33.032027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b41b6b09-cc5c-4e07-b142-896360e2a8d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:33.034123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b41b6b09-cc5c-4e07-b142-896360e2a8d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:33.041027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b41b6b09-cc5c-4e07-b142-896360e2a8d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:33.041506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b41b6b09-cc5c-4e07-b142-896360e2a8d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:33.041944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b41b6b09-cc5c-4e07-b142-896360e2a8d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:33.042634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b41b6b09-cc5c-4e07-b142-896360e2a8d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:33.043085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b41b6b09-cc5c-4e07-b142-896360e2a8d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:33.043510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b41b6b09-cc5c-4e07-b142-896360e2a8d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:33.072025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b41b6b09-cc5c-4e07-b142-896360e2a8d2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Aug 22 19:37:33.072565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 590/1320] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:33 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:33.153149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-09d4b10b-7c19-4236-8801-ea637d484935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:33.155270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-09d4b10b-7c19-4236-8801-ea637d484935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:33.162198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09d4b10b-7c19-4236-8801-ea637d484935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:33.162678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09d4b10b-7c19-4236-8801-ea637d484935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:33.163109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09d4b10b-7c19-4236-8801-ea637d484935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:33.163841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09d4b10b-7c19-4236-8801-ea637d484935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:33.164289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09d4b10b-7c19-4236-8801-ea637d484935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:33.164707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09d4b10b-7c19-4236-8801-ea637d484935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:33.192221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-09d4b10b-7c19-4236-8801-ea637d484935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 Aug 22 19:37:33.192766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 731/1321] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:34.084219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-76adb482-a833-4348-a930-fa15fb173408 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:34.086585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-76adb482-a833-4348-a930-fa15fb173408 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:34.093158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76adb482-a833-4348-a930-fa15fb173408 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:34.093575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76adb482-a833-4348-a930-fa15fb173408 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:34.094001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76adb482-a833-4348-a930-fa15fb173408 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:34.094691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76adb482-a833-4348-a930-fa15fb173408 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:34.095165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76adb482-a833-4348-a930-fa15fb173408 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:34.095579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-76adb482-a833-4348-a930-fa15fb173408 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:34.121421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:34.126750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-76adb482-a833-4348-a930-fa15fb173408 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Aug 22 19:37:34.127325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 591/1322] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:34.204555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4e0ed615-c59c-41b2-80d1-85d17ea9d6b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:34.206787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4e0ed615-c59c-41b2-80d1-85d17ea9d6b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:34.214121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e0ed615-c59c-41b2-80d1-85d17ea9d6b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:34.214597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e0ed615-c59c-41b2-80d1-85d17ea9d6b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:34.215030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e0ed615-c59c-41b2-80d1-85d17ea9d6b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:34.215767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e0ed615-c59c-41b2-80d1-85d17ea9d6b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:34.216214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e0ed615-c59c-41b2-80d1-85d17ea9d6b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:34.216632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e0ed615-c59c-41b2-80d1-85d17ea9d6b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:34.234151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:34.247946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4e0ed615-c59c-41b2-80d1-85d17ea9d6b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Aug 22 19:37:34.248514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 732/1323] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:34 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:35.139784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-222377f0-a3b5-4b9e-b366-594b9ff26611 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:35.141906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-222377f0-a3b5-4b9e-b366-594b9ff26611 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:35.149271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-222377f0-a3b5-4b9e-b366-594b9ff26611 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:35.149760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-222377f0-a3b5-4b9e-b366-594b9ff26611 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:35.150195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-222377f0-a3b5-4b9e-b366-594b9ff26611 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:35.150895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-222377f0-a3b5-4b9e-b366-594b9ff26611 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:35.151372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-222377f0-a3b5-4b9e-b366-594b9ff26611 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:35.151834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-222377f0-a3b5-4b9e-b366-594b9ff26611 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:35.180078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-222377f0-a3b5-4b9e-b366-594b9ff26611 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 Aug 22 19:37:35.180649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 592/1324] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:35 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:35.260682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f27ba3b9-bcdb-4ab5-8dd9-917e9b1ee734 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:35.262830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f27ba3b9-bcdb-4ab5-8dd9-917e9b1ee734 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:35.271633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f27ba3b9-bcdb-4ab5-8dd9-917e9b1ee734 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:35.272593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f27ba3b9-bcdb-4ab5-8dd9-917e9b1ee734 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:35.273419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f27ba3b9-bcdb-4ab5-8dd9-917e9b1ee734 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:35.274169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f27ba3b9-bcdb-4ab5-8dd9-917e9b1ee734 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:35.274634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f27ba3b9-bcdb-4ab5-8dd9-917e9b1ee734 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:35.275068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f27ba3b9-bcdb-4ab5-8dd9-917e9b1ee734 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:35.305119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f27ba3b9-bcdb-4ab5-8dd9-917e9b1ee734 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048300 Aug 22 19:37:35.305601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 733/1325] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:36.192294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49b1536d-f467-4804-9802-2d62d993e1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:36.194443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49b1536d-f467-4804-9802-2d62d993e1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:36.200817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b1536d-f467-4804-9802-2d62d993e1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:36.201296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b1536d-f467-4804-9802-2d62d993e1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:36.201726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b1536d-f467-4804-9802-2d62d993e1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:36.202424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b1536d-f467-4804-9802-2d62d993e1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:36.202873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b1536d-f467-4804-9802-2d62d993e1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:36.203293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b1536d-f467-4804-9802-2d62d993e1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:36.232712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49b1536d-f467-4804-9802-2d62d993e1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Aug 22 19:37:36.233267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 593/1326] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:36.317489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d7668cd4-f2e8-466e-9bac-2ea97caad8d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:36.319532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d7668cd4-f2e8-466e-9bac-2ea97caad8d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:36.325874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7668cd4-f2e8-466e-9bac-2ea97caad8d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:36.326347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7668cd4-f2e8-466e-9bac-2ea97caad8d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:36.326778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7668cd4-f2e8-466e-9bac-2ea97caad8d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:36.327470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7668cd4-f2e8-466e-9bac-2ea97caad8d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:36.327951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7668cd4-f2e8-466e-9bac-2ea97caad8d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:36.328375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7668cd4-f2e8-466e-9bac-2ea97caad8d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:36.357605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d7668cd4-f2e8-466e-9bac-2ea97caad8d4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Aug 22 19:37:36.358154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 734/1327] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:37.244891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6107739e-3190-4adc-93bb-343368b39ac8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:37.247034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6107739e-3190-4adc-93bb-343368b39ac8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:37.253327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6107739e-3190-4adc-93bb-343368b39ac8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:37.253809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6107739e-3190-4adc-93bb-343368b39ac8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:37.254241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6107739e-3190-4adc-93bb-343368b39ac8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:37.254925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6107739e-3190-4adc-93bb-343368b39ac8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:37.255905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6107739e-3190-4adc-93bb-343368b39ac8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:37.256335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6107739e-3190-4adc-93bb-343368b39ac8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:37.285140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6107739e-3190-4adc-93bb-343368b39ac8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Aug 22 19:37:37.285681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 594/1328] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:37.370884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-64e04457-fc35-414f-950b-c5a706840fe5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:37.373548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-64e04457-fc35-414f-950b-c5a706840fe5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:37.379886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64e04457-fc35-414f-950b-c5a706840fe5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:37.380871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64e04457-fc35-414f-950b-c5a706840fe5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:37.381324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64e04457-fc35-414f-950b-c5a706840fe5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:37.382007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64e04457-fc35-414f-950b-c5a706840fe5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:37.382452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64e04457-fc35-414f-950b-c5a706840fe5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:37.383530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64e04457-fc35-414f-950b-c5a706840fe5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:37.413408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-64e04457-fc35-414f-950b-c5a706840fe5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046304 Aug 22 19:37:37.413884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 735/1329] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:38.297677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ce3c1da-cb5c-4be4-9474-3a9b079d2ac6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:38.300108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ce3c1da-cb5c-4be4-9474-3a9b079d2ac6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:38.306582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce3c1da-cb5c-4be4-9474-3a9b079d2ac6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:38.307067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce3c1da-cb5c-4be4-9474-3a9b079d2ac6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:38.307500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce3c1da-cb5c-4be4-9474-3a9b079d2ac6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:38.308241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce3c1da-cb5c-4be4-9474-3a9b079d2ac6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:38.308691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce3c1da-cb5c-4be4-9474-3a9b079d2ac6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:38.309114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce3c1da-cb5c-4be4-9474-3a9b079d2ac6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:38.340130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ce3c1da-cb5c-4be4-9474-3a9b079d2ac6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Aug 22 19:37:38.340701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 595/1330] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:38.425600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f072ee3b-50e1-4b6f-a3a7-ca0d17e0b4de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:38.427694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f072ee3b-50e1-4b6f-a3a7-ca0d17e0b4de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:38.434888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f072ee3b-50e1-4b6f-a3a7-ca0d17e0b4de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:38.435374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f072ee3b-50e1-4b6f-a3a7-ca0d17e0b4de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:38.435921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f072ee3b-50e1-4b6f-a3a7-ca0d17e0b4de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:38.436631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f072ee3b-50e1-4b6f-a3a7-ca0d17e0b4de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:38.437082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f072ee3b-50e1-4b6f-a3a7-ca0d17e0b4de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:38.437505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f072ee3b-50e1-4b6f-a3a7-ca0d17e0b4de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:38.468199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f072ee3b-50e1-4b6f-a3a7-ca0d17e0b4de tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046667 Aug 22 19:37:38.468785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 736/1331] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:39.352996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38aa87dd-91e4-4813-b02f-1f2054245909 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:39.355118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38aa87dd-91e4-4813-b02f-1f2054245909 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:39.361800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38aa87dd-91e4-4813-b02f-1f2054245909 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:39.362281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38aa87dd-91e4-4813-b02f-1f2054245909 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:39.362714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38aa87dd-91e4-4813-b02f-1f2054245909 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:39.363416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38aa87dd-91e4-4813-b02f-1f2054245909 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:39.363906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38aa87dd-91e4-4813-b02f-1f2054245909 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:39.364332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38aa87dd-91e4-4813-b02f-1f2054245909 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:39.395098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38aa87dd-91e4-4813-b02f-1f2054245909 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046567 Aug 22 19:37:39.395683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 596/1332] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:39 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:39.480319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6aaba6ce-a8fe-4c55-831c-e07364517dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:39.482573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6aaba6ce-a8fe-4c55-831c-e07364517dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:39.489162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6aaba6ce-a8fe-4c55-831c-e07364517dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:39.489647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6aaba6ce-a8fe-4c55-831c-e07364517dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:39.490108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6aaba6ce-a8fe-4c55-831c-e07364517dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:39.490805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6aaba6ce-a8fe-4c55-831c-e07364517dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:39.491831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6aaba6ce-a8fe-4c55-831c-e07364517dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:39.492263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6aaba6ce-a8fe-4c55-831c-e07364517dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:39.522694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6aaba6ce-a8fe-4c55-831c-e07364517dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046748 Aug 22 19:37:39.523515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 737/1333] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:40.407739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf823885-822c-45a0-9377-70a74470c865 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:40.409861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf823885-822c-45a0-9377-70a74470c865 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:40.416542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf823885-822c-45a0-9377-70a74470c865 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:40.417030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf823885-822c-45a0-9377-70a74470c865 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:40.417463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf823885-822c-45a0-9377-70a74470c865 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:40.418162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf823885-822c-45a0-9377-70a74470c865 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:40.418647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf823885-822c-45a0-9377-70a74470c865 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:40.419074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf823885-822c-45a0-9377-70a74470c865 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:40.450215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf823885-822c-45a0-9377-70a74470c865 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046379 Aug 22 19:37:40.450812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 597/1334] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:40.534362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c00f9587-54cd-44d6-8b6d-126128dcb6d1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:40.536626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c00f9587-54cd-44d6-8b6d-126128dcb6d1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:40.543105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00f9587-54cd-44d6-8b6d-126128dcb6d1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:40.543584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00f9587-54cd-44d6-8b6d-126128dcb6d1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:40.544112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00f9587-54cd-44d6-8b6d-126128dcb6d1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:40.544822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00f9587-54cd-44d6-8b6d-126128dcb6d1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:40.545271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00f9587-54cd-44d6-8b6d-126128dcb6d1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:40.545697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c00f9587-54cd-44d6-8b6d-126128dcb6d1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:40.577062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c00f9587-54cd-44d6-8b6d-126128dcb6d1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046612 Aug 22 19:37:40.577659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 738/1335] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:41.463214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-699552bf-442d-4a0e-9ec2-6cbfb2f77abe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:41.465387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-699552bf-442d-4a0e-9ec2-6cbfb2f77abe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:41.471869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699552bf-442d-4a0e-9ec2-6cbfb2f77abe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:41.472349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699552bf-442d-4a0e-9ec2-6cbfb2f77abe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:41.472779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699552bf-442d-4a0e-9ec2-6cbfb2f77abe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:41.473474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699552bf-442d-4a0e-9ec2-6cbfb2f77abe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:41.473920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699552bf-442d-4a0e-9ec2-6cbfb2f77abe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:41.474335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-699552bf-442d-4a0e-9ec2-6cbfb2f77abe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:41.504427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-699552bf-442d-4a0e-9ec2-6cbfb2f77abe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Aug 22 19:37:41.504966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 598/1336] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:41.590203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a72d10c5-e05a-4632-9b1b-e5924f79c2ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:41.592391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a72d10c5-e05a-4632-9b1b-e5924f79c2ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:41.598936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a72d10c5-e05a-4632-9b1b-e5924f79c2ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:41.599419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a72d10c5-e05a-4632-9b1b-e5924f79c2ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:41.599882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a72d10c5-e05a-4632-9b1b-e5924f79c2ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:41.601156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a72d10c5-e05a-4632-9b1b-e5924f79c2ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:41.601607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a72d10c5-e05a-4632-9b1b-e5924f79c2ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:41.602029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a72d10c5-e05a-4632-9b1b-e5924f79c2ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:41.631591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a72d10c5-e05a-4632-9b1b-e5924f79c2ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045565 Aug 22 19:37:41.632223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 739/1337] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:42.516891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc2994a7-0f81-4098-b7ff-16db0d99bf9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:42.519056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc2994a7-0f81-4098-b7ff-16db0d99bf9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:42.526295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2994a7-0f81-4098-b7ff-16db0d99bf9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:42.526775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2994a7-0f81-4098-b7ff-16db0d99bf9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:42.527201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2994a7-0f81-4098-b7ff-16db0d99bf9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:42.527927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2994a7-0f81-4098-b7ff-16db0d99bf9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:42.528379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2994a7-0f81-4098-b7ff-16db0d99bf9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:42.528799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2994a7-0f81-4098-b7ff-16db0d99bf9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:42.559172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc2994a7-0f81-4098-b7ff-16db0d99bf9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046276 Aug 22 19:37:42.559838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 599/1338] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:42.644217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-51e45cf4-894d-476b-9f92-77f38a5d8378 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:42.646428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-51e45cf4-894d-476b-9f92-77f38a5d8378 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:42.657977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51e45cf4-894d-476b-9f92-77f38a5d8378 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:42.657977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51e45cf4-894d-476b-9f92-77f38a5d8378 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:42.657977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51e45cf4-894d-476b-9f92-77f38a5d8378 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:42.657977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51e45cf4-894d-476b-9f92-77f38a5d8378 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:42.658292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51e45cf4-894d-476b-9f92-77f38a5d8378 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:42.658292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51e45cf4-894d-476b-9f92-77f38a5d8378 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:42.690399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-51e45cf4-894d-476b-9f92-77f38a5d8378 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050088 Aug 22 19:37:42.690986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 740/1339] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:43.571902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-943ac98e-e59f-453a-bc36-989cf2a3699b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:43.574030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-943ac98e-e59f-453a-bc36-989cf2a3699b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:43.580621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943ac98e-e59f-453a-bc36-989cf2a3699b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:43.581126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943ac98e-e59f-453a-bc36-989cf2a3699b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:43.581562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943ac98e-e59f-453a-bc36-989cf2a3699b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:43.582255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943ac98e-e59f-453a-bc36-989cf2a3699b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:43.582701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943ac98e-e59f-453a-bc36-989cf2a3699b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:43.583117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-943ac98e-e59f-453a-bc36-989cf2a3699b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:43.613618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-943ac98e-e59f-453a-bc36-989cf2a3699b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046655 Aug 22 19:37:43.614225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 600/1340] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:43.702662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5c7078cd-722a-4713-991f-962c56fa30c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:43.705329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5c7078cd-722a-4713-991f-962c56fa30c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:43.712307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c7078cd-722a-4713-991f-962c56fa30c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:43.712820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c7078cd-722a-4713-991f-962c56fa30c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:43.713252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c7078cd-722a-4713-991f-962c56fa30c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:43.713969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c7078cd-722a-4713-991f-962c56fa30c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:43.714414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c7078cd-722a-4713-991f-962c56fa30c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:43.714837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c7078cd-722a-4713-991f-962c56fa30c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:43.744811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5c7078cd-722a-4713-991f-962c56fa30c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Aug 22 19:37:43.745384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 741/1341] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:43 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:44.626291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3c30c45-61ec-4ebd-9b48-bc0a2dffb837 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:44.628593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3c30c45-61ec-4ebd-9b48-bc0a2dffb837 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:44.630973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=58 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:44.636282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c30c45-61ec-4ebd-9b48-bc0a2dffb837 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:44.636759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c30c45-61ec-4ebd-9b48-bc0a2dffb837 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:44.637183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c30c45-61ec-4ebd-9b48-bc0a2dffb837 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:44.637876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c30c45-61ec-4ebd-9b48-bc0a2dffb837 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:44.638331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c30c45-61ec-4ebd-9b48-bc0a2dffb837 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:44.638739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c30c45-61ec-4ebd-9b48-bc0a2dffb837 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:44.669453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3c30c45-61ec-4ebd-9b48-bc0a2dffb837 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Aug 22 19:37:44.670031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 601/1342] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:44 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:44.757975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-35b769b8-e6ce-47a5-9fe1-4f0170fe3ded tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:44.760148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-35b769b8-e6ce-47a5-9fe1-4f0170fe3ded tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:44.762674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=58 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:44.768917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35b769b8-e6ce-47a5-9fe1-4f0170fe3ded tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:44.769400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35b769b8-e6ce-47a5-9fe1-4f0170fe3ded tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:44.769835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35b769b8-e6ce-47a5-9fe1-4f0170fe3ded tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:44.770539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35b769b8-e6ce-47a5-9fe1-4f0170fe3ded tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:44.770984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35b769b8-e6ce-47a5-9fe1-4f0170fe3ded tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:44.771400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35b769b8-e6ce-47a5-9fe1-4f0170fe3ded tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:44.802998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-35b769b8-e6ce-47a5-9fe1-4f0170fe3ded tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049470 Aug 22 19:37:44.803593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 742/1343] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:45.682787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12354f21-20d1-4652-951d-ed6394824ee1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:45.685055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12354f21-20d1-4652-951d-ed6394824ee1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:45.691896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12354f21-20d1-4652-951d-ed6394824ee1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:45.692383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12354f21-20d1-4652-951d-ed6394824ee1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:45.692814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12354f21-20d1-4652-951d-ed6394824ee1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:45.693512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12354f21-20d1-4652-951d-ed6394824ee1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:45.693955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12354f21-20d1-4652-951d-ed6394824ee1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:45.694409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12354f21-20d1-4652-951d-ed6394824ee1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:45.724263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12354f21-20d1-4652-951d-ed6394824ee1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Aug 22 19:37:45.724829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 602/1344] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:45 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:45.815710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b839c56-ab2e-4eda-8dce-216c54915ef1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:45.817759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b839c56-ab2e-4eda-8dce-216c54915ef1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:45.824478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b839c56-ab2e-4eda-8dce-216c54915ef1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:45.824962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b839c56-ab2e-4eda-8dce-216c54915ef1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:45.825392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b839c56-ab2e-4eda-8dce-216c54915ef1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:45.826093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b839c56-ab2e-4eda-8dce-216c54915ef1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:45.826540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b839c56-ab2e-4eda-8dce-216c54915ef1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:45.828509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b839c56-ab2e-4eda-8dce-216c54915ef1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:45.861238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b839c56-ab2e-4eda-8dce-216c54915ef1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049528 Aug 22 19:37:45.861810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 743/1345] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:46.738168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb3736f2-c742-4a45-b7cb-957ef7d68fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:46.740421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb3736f2-c742-4a45-b7cb-957ef7d68fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:46.747161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3736f2-c742-4a45-b7cb-957ef7d68fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:46.747711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3736f2-c742-4a45-b7cb-957ef7d68fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:46.748105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3736f2-c742-4a45-b7cb-957ef7d68fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:46.748809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3736f2-c742-4a45-b7cb-957ef7d68fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:46.749265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3736f2-c742-4a45-b7cb-957ef7d68fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:46.749688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3736f2-c742-4a45-b7cb-957ef7d68fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:46.782942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb3736f2-c742-4a45-b7cb-957ef7d68fb7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048582 Aug 22 19:37:46.783519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 603/1346] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:46.875435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eb104a4a-3034-49ad-b26d-ed13c1c28dae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:46.877646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eb104a4a-3034-49ad-b26d-ed13c1c28dae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:46.884187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb104a4a-3034-49ad-b26d-ed13c1c28dae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:46.884672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb104a4a-3034-49ad-b26d-ed13c1c28dae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:46.885101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb104a4a-3034-49ad-b26d-ed13c1c28dae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:46.885806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb104a4a-3034-49ad-b26d-ed13c1c28dae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:46.886257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb104a4a-3034-49ad-b26d-ed13c1c28dae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:46.886681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eb104a4a-3034-49ad-b26d-ed13c1c28dae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:46.917249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eb104a4a-3034-49ad-b26d-ed13c1c28dae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045747 Aug 22 19:37:46.917828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 744/1347] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:47.795009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f698e58d-afde-4fb9-b083-41d4116d4e62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:47.797335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f698e58d-afde-4fb9-b083-41d4116d4e62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:47.804598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f698e58d-afde-4fb9-b083-41d4116d4e62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:47.805085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f698e58d-afde-4fb9-b083-41d4116d4e62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:47.805509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f698e58d-afde-4fb9-b083-41d4116d4e62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:47.806219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f698e58d-afde-4fb9-b083-41d4116d4e62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:47.806668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f698e58d-afde-4fb9-b083-41d4116d4e62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:47.807094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f698e58d-afde-4fb9-b083-41d4116d4e62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:47.837305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f698e58d-afde-4fb9-b083-41d4116d4e62 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Aug 22 19:37:47.837845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 604/1348] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:47.930495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c231176b-6030-4323-a888-92dc8d4c06d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:47.932708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c231176b-6030-4323-a888-92dc8d4c06d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:47.939314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c231176b-6030-4323-a888-92dc8d4c06d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:47.939830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c231176b-6030-4323-a888-92dc8d4c06d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:47.940282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c231176b-6030-4323-a888-92dc8d4c06d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:47.940966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c231176b-6030-4323-a888-92dc8d4c06d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:47.941414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c231176b-6030-4323-a888-92dc8d4c06d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:47.941835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c231176b-6030-4323-a888-92dc8d4c06d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:47.972099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c231176b-6030-4323-a888-92dc8d4c06d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046109 Aug 22 19:37:47.972677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 745/1349] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:48.849954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f5c8658-5883-4115-9554-b72ddfe9eff9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:48.852214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f5c8658-5883-4115-9554-b72ddfe9eff9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:48.860818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f5c8658-5883-4115-9554-b72ddfe9eff9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:48.860818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f5c8658-5883-4115-9554-b72ddfe9eff9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:48.860818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f5c8658-5883-4115-9554-b72ddfe9eff9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:48.860818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f5c8658-5883-4115-9554-b72ddfe9eff9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:48.861157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f5c8658-5883-4115-9554-b72ddfe9eff9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:48.861368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f5c8658-5883-4115-9554-b72ddfe9eff9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:48.892097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f5c8658-5883-4115-9554-b72ddfe9eff9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046120 Aug 22 19:37:48.892670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 605/1350] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:48.985131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c3f991d4-fa4b-48db-818d-040aade38dfb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:48.987268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c3f991d4-fa4b-48db-818d-040aade38dfb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:48.993804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3f991d4-fa4b-48db-818d-040aade38dfb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:48.994286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3f991d4-fa4b-48db-818d-040aade38dfb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:48.994721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3f991d4-fa4b-48db-818d-040aade38dfb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:48.995423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3f991d4-fa4b-48db-818d-040aade38dfb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:48.995988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3f991d4-fa4b-48db-818d-040aade38dfb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:48.996418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3f991d4-fa4b-48db-818d-040aade38dfb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:49.027070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c3f991d4-fa4b-48db-818d-040aade38dfb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Aug 22 19:37:49.027636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 746/1351] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:49.904577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38635858-792a-467f-b4ab-35fb5a371e55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:49.906713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38635858-792a-467f-b4ab-35fb5a371e55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:49.913641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38635858-792a-467f-b4ab-35fb5a371e55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:49.918054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38635858-792a-467f-b4ab-35fb5a371e55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:49.918054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38635858-792a-467f-b4ab-35fb5a371e55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:49.918054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38635858-792a-467f-b4ab-35fb5a371e55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:49.918054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38635858-792a-467f-b4ab-35fb5a371e55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:49.920343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38635858-792a-467f-b4ab-35fb5a371e55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:49.946610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38635858-792a-467f-b4ab-35fb5a371e55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Aug 22 19:37:49.947177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 606/1352] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:50.039389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-510246b5-0890-4695-95a3-3330bbf9ae8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:50.041575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-510246b5-0890-4695-95a3-3330bbf9ae8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:50.048615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510246b5-0890-4695-95a3-3330bbf9ae8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:50.049103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510246b5-0890-4695-95a3-3330bbf9ae8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:50.049543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510246b5-0890-4695-95a3-3330bbf9ae8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:50.050278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510246b5-0890-4695-95a3-3330bbf9ae8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:50.050736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510246b5-0890-4695-95a3-3330bbf9ae8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:50.051164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510246b5-0890-4695-95a3-3330bbf9ae8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:50.081558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-510246b5-0890-4695-95a3-3330bbf9ae8c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046028 Aug 22 19:37:50.082138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 747/1353] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:50.959397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3843def-8e98-4833-aed4-8d19a2b5965e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:50.962499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b3843def-8e98-4833-aed4-8d19a2b5965e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:50.969335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3843def-8e98-4833-aed4-8d19a2b5965e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:50.969808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3843def-8e98-4833-aed4-8d19a2b5965e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:50.970233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3843def-8e98-4833-aed4-8d19a2b5965e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:50.970931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3843def-8e98-4833-aed4-8d19a2b5965e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:50.971380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3843def-8e98-4833-aed4-8d19a2b5965e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:50.971831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3843def-8e98-4833-aed4-8d19a2b5965e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:51.001644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3843def-8e98-4833-aed4-8d19a2b5965e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046095 Aug 22 19:37:51.002209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 607/1354] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:50 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:51.095084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1ad64739-ad3e-41a8-a75c-5249752dff11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:51.097195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1ad64739-ad3e-41a8-a75c-5249752dff11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:51.103655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ad64739-ad3e-41a8-a75c-5249752dff11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:51.104465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ad64739-ad3e-41a8-a75c-5249752dff11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:51.104637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ad64739-ad3e-41a8-a75c-5249752dff11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:51.105306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ad64739-ad3e-41a8-a75c-5249752dff11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:51.105776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ad64739-ad3e-41a8-a75c-5249752dff11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:51.106199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ad64739-ad3e-41a8-a75c-5249752dff11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:51.138308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1ad64739-ad3e-41a8-a75c-5249752dff11 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047264 Aug 22 19:37:51.138884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 748/1355] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:52.014584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-203c8f37-22df-4b7b-aba1-4ee749d2dad4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:52.016757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-203c8f37-22df-4b7b-aba1-4ee749d2dad4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:52.024035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203c8f37-22df-4b7b-aba1-4ee749d2dad4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:52.024706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203c8f37-22df-4b7b-aba1-4ee749d2dad4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:52.025168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203c8f37-22df-4b7b-aba1-4ee749d2dad4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:52.026073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203c8f37-22df-4b7b-aba1-4ee749d2dad4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:52.026819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203c8f37-22df-4b7b-aba1-4ee749d2dad4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:52.027249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203c8f37-22df-4b7b-aba1-4ee749d2dad4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:52.045046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:52.058358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-203c8f37-22df-4b7b-aba1-4ee749d2dad4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047730 Aug 22 19:37:52.059425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 608/1356] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:52.150487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-554307c2-8200-4164-90b5-957f263fce1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:52.152747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-554307c2-8200-4164-90b5-957f263fce1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:52.159179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-554307c2-8200-4164-90b5-957f263fce1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:52.159695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-554307c2-8200-4164-90b5-957f263fce1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:52.160138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-554307c2-8200-4164-90b5-957f263fce1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:52.160831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-554307c2-8200-4164-90b5-957f263fce1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:52.161284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-554307c2-8200-4164-90b5-957f263fce1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:52.161724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-554307c2-8200-4164-90b5-957f263fce1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:52.165982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:37:52.191788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-554307c2-8200-4164-90b5-957f263fce1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045684 Aug 22 19:37:52.192351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 749/1357] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:53.070623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff63e748-4733-4fc5-9278-9ee3fda35061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:53.072870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff63e748-4733-4fc5-9278-9ee3fda35061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:53.079292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff63e748-4733-4fc5-9278-9ee3fda35061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:53.080156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff63e748-4733-4fc5-9278-9ee3fda35061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:53.080593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff63e748-4733-4fc5-9278-9ee3fda35061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:53.081322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff63e748-4733-4fc5-9278-9ee3fda35061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:53.081775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff63e748-4733-4fc5-9278-9ee3fda35061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:53.082196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff63e748-4733-4fc5-9278-9ee3fda35061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:53.113876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff63e748-4733-4fc5-9278-9ee3fda35061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047157 Aug 22 19:37:53.114707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 609/1358] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:53.204434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f9e5f5f2-5492-45ac-8298-6130619eb1a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:53.206575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f9e5f5f2-5492-45ac-8298-6130619eb1a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:53.213271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9e5f5f2-5492-45ac-8298-6130619eb1a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:53.213753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9e5f5f2-5492-45ac-8298-6130619eb1a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:53.214185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9e5f5f2-5492-45ac-8298-6130619eb1a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:53.214884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9e5f5f2-5492-45ac-8298-6130619eb1a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:53.215334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9e5f5f2-5492-45ac-8298-6130619eb1a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:53.215794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9e5f5f2-5492-45ac-8298-6130619eb1a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:53.245480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f9e5f5f2-5492-45ac-8298-6130619eb1a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Aug 22 19:37:53.246039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 750/1359] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:54.002171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:37:54.002401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:37:54.126234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-253ac8b1-12e7-4936-bb9c-43070145ac00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:54.128424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-253ac8b1-12e7-4936-bb9c-43070145ac00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:54.134660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-253ac8b1-12e7-4936-bb9c-43070145ac00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:54.135141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-253ac8b1-12e7-4936-bb9c-43070145ac00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:54.135577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-253ac8b1-12e7-4936-bb9c-43070145ac00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:54.136302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-253ac8b1-12e7-4936-bb9c-43070145ac00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:54.136759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-253ac8b1-12e7-4936-bb9c-43070145ac00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:54.137191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-253ac8b1-12e7-4936-bb9c-43070145ac00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:54.168668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-253ac8b1-12e7-4936-bb9c-43070145ac00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046275 Aug 22 19:37:54.169226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 610/1360] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:54.257969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-52b2f34f-71a6-441d-bffd-c110d06e6dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:54.263434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-52b2f34f-71a6-441d-bffd-c110d06e6dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:54.266758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52b2f34f-71a6-441d-bffd-c110d06e6dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:54.267238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52b2f34f-71a6-441d-bffd-c110d06e6dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:54.267698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52b2f34f-71a6-441d-bffd-c110d06e6dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:54.268401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52b2f34f-71a6-441d-bffd-c110d06e6dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:54.268845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52b2f34f-71a6-441d-bffd-c110d06e6dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:54.269263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52b2f34f-71a6-441d-bffd-c110d06e6dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:54.301181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-52b2f34f-71a6-441d-bffd-c110d06e6dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047033 Aug 22 19:37:54.302155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 751/1361] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:55.181755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80cffc4b-08f4-46ca-bd64-2b01bb5db005 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:55.183912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80cffc4b-08f4-46ca-bd64-2b01bb5db005 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:55.190221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80cffc4b-08f4-46ca-bd64-2b01bb5db005 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:55.190697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80cffc4b-08f4-46ca-bd64-2b01bb5db005 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:55.191124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80cffc4b-08f4-46ca-bd64-2b01bb5db005 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:55.191849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80cffc4b-08f4-46ca-bd64-2b01bb5db005 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:55.192300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80cffc4b-08f4-46ca-bd64-2b01bb5db005 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:55.192722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80cffc4b-08f4-46ca-bd64-2b01bb5db005 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:55.223667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80cffc4b-08f4-46ca-bd64-2b01bb5db005 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046620 Aug 22 19:37:55.224467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 611/1362] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:55 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:55.313986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-35df3fef-adbf-447e-a75b-45aa2909cb57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:55.316192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-35df3fef-adbf-447e-a75b-45aa2909cb57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:55.323193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35df3fef-adbf-447e-a75b-45aa2909cb57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:55.323703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35df3fef-adbf-447e-a75b-45aa2909cb57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:55.324141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35df3fef-adbf-447e-a75b-45aa2909cb57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:55.324840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35df3fef-adbf-447e-a75b-45aa2909cb57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:55.325299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35df3fef-adbf-447e-a75b-45aa2909cb57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:55.325723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35df3fef-adbf-447e-a75b-45aa2909cb57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:55.355542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-35df3fef-adbf-447e-a75b-45aa2909cb57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Aug 22 19:37:55.356144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 752/1363] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:56.236217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c33b580-0dc1-4fb8-8b0a-d6fcf13211c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:56.238360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1c33b580-0dc1-4fb8-8b0a-d6fcf13211c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:56.245604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c33b580-0dc1-4fb8-8b0a-d6fcf13211c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:56.246089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c33b580-0dc1-4fb8-8b0a-d6fcf13211c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:56.246519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c33b580-0dc1-4fb8-8b0a-d6fcf13211c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:56.247229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c33b580-0dc1-4fb8-8b0a-d6fcf13211c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:56.247698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c33b580-0dc1-4fb8-8b0a-d6fcf13211c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:56.248118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c33b580-0dc1-4fb8-8b0a-d6fcf13211c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:56.277616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c33b580-0dc1-4fb8-8b0a-d6fcf13211c0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045440 Aug 22 19:37:56.278182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 612/1364] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:56 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:56.368594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e30eabef-ba29-4029-8bbd-8c61a5789aca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:56.370651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e30eabef-ba29-4029-8bbd-8c61a5789aca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:56.377106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e30eabef-ba29-4029-8bbd-8c61a5789aca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:56.377592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e30eabef-ba29-4029-8bbd-8c61a5789aca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:56.378037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e30eabef-ba29-4029-8bbd-8c61a5789aca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:56.378744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e30eabef-ba29-4029-8bbd-8c61a5789aca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:56.379198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e30eabef-ba29-4029-8bbd-8c61a5789aca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:56.379624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e30eabef-ba29-4029-8bbd-8c61a5789aca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:56.408990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e30eabef-ba29-4029-8bbd-8c61a5789aca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Aug 22 19:37:56.409554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 753/1365] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:57.290807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ccaa7e8f-e256-4f6c-83a6-7e871cc59ebe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:57.293322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ccaa7e8f-e256-4f6c-83a6-7e871cc59ebe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:57.299475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccaa7e8f-e256-4f6c-83a6-7e871cc59ebe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:57.299985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccaa7e8f-e256-4f6c-83a6-7e871cc59ebe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:57.300409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccaa7e8f-e256-4f6c-83a6-7e871cc59ebe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:57.301123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccaa7e8f-e256-4f6c-83a6-7e871cc59ebe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:57.301570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccaa7e8f-e256-4f6c-83a6-7e871cc59ebe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:57.301986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccaa7e8f-e256-4f6c-83a6-7e871cc59ebe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:57.330998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ccaa7e8f-e256-4f6c-83a6-7e871cc59ebe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Aug 22 19:37:57.331578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 613/1366] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:57 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:57.422089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b94f4199-5c18-4434-a1ec-5a41d3c8d880 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:57.424193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b94f4199-5c18-4434-a1ec-5a41d3c8d880 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:57.430585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b94f4199-5c18-4434-a1ec-5a41d3c8d880 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:57.431060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b94f4199-5c18-4434-a1ec-5a41d3c8d880 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:57.431488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b94f4199-5c18-4434-a1ec-5a41d3c8d880 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:57.432201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b94f4199-5c18-4434-a1ec-5a41d3c8d880 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:57.432654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b94f4199-5c18-4434-a1ec-5a41d3c8d880 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:57.433067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b94f4199-5c18-4434-a1ec-5a41d3c8d880 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:57.462554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b94f4199-5c18-4434-a1ec-5a41d3c8d880 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044507 Aug 22 19:37:57.463140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 754/1367] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:58.344321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ebca214-67ed-474e-b85a-3bb41aadc5c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:58.346369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ebca214-67ed-474e-b85a-3bb41aadc5c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:58.352636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ebca214-67ed-474e-b85a-3bb41aadc5c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:58.353122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ebca214-67ed-474e-b85a-3bb41aadc5c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:58.353613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ebca214-67ed-474e-b85a-3bb41aadc5c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:58.354321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ebca214-67ed-474e-b85a-3bb41aadc5c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:58.354776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ebca214-67ed-474e-b85a-3bb41aadc5c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:58.355230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ebca214-67ed-474e-b85a-3bb41aadc5c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:58.385843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ebca214-67ed-474e-b85a-3bb41aadc5c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Aug 22 19:37:58.386719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 614/1368] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:58 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:58.474686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-df23482a-4f96-4ffa-ab16-d97a4ad496df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:58.476852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-df23482a-4f96-4ffa-ab16-d97a4ad496df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:58.483111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df23482a-4f96-4ffa-ab16-d97a4ad496df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:58.483583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df23482a-4f96-4ffa-ab16-d97a4ad496df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:58.484037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df23482a-4f96-4ffa-ab16-d97a4ad496df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:58.484717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df23482a-4f96-4ffa-ab16-d97a4ad496df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:58.485160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df23482a-4f96-4ffa-ab16-d97a4ad496df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:58.485579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df23482a-4f96-4ffa-ab16-d97a4ad496df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:58.513977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-df23482a-4f96-4ffa-ab16-d97a4ad496df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043171 Aug 22 19:37:58.514512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 755/1369] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:59.398147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17979c73-9795-4afa-8c09-0ccf80bbc920 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:59.400358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17979c73-9795-4afa-8c09-0ccf80bbc920 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:59.406740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17979c73-9795-4afa-8c09-0ccf80bbc920 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:59.407223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17979c73-9795-4afa-8c09-0ccf80bbc920 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:59.407682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17979c73-9795-4afa-8c09-0ccf80bbc920 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:59.408379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17979c73-9795-4afa-8c09-0ccf80bbc920 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:59.408835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17979c73-9795-4afa-8c09-0ccf80bbc920 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:59.409259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17979c73-9795-4afa-8c09-0ccf80bbc920 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:59.438831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17979c73-9795-4afa-8c09-0ccf80bbc920 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Aug 22 19:37:59.439392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 615/1370] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:59 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:37:59.526230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2a16d22e-748d-43a4-93ce-d1f4bf54f551 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:37:59.528335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2a16d22e-748d-43a4-93ce-d1f4bf54f551 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:37:59.534637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a16d22e-748d-43a4-93ce-d1f4bf54f551 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:59.535107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a16d22e-748d-43a4-93ce-d1f4bf54f551 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:59.535534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a16d22e-748d-43a4-93ce-d1f4bf54f551 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:59.536248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a16d22e-748d-43a4-93ce-d1f4bf54f551 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:37:59.536691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a16d22e-748d-43a4-93ce-d1f4bf54f551 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:37:59.537106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a16d22e-748d-43a4-93ce-d1f4bf54f551 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:37:59.565434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2a16d22e-748d-43a4-93ce-d1f4bf54f551 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043276 Aug 22 19:37:59.565965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 756/1371] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:37:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:00.452521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf04f31b-ee93-467a-8edf-bf9ac2d40c32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:00.454642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf04f31b-ee93-467a-8edf-bf9ac2d40c32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:00.461384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf04f31b-ee93-467a-8edf-bf9ac2d40c32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:00.461864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf04f31b-ee93-467a-8edf-bf9ac2d40c32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:00.462295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf04f31b-ee93-467a-8edf-bf9ac2d40c32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:00.462987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf04f31b-ee93-467a-8edf-bf9ac2d40c32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:00.463445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf04f31b-ee93-467a-8edf-bf9ac2d40c32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:00.463904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf04f31b-ee93-467a-8edf-bf9ac2d40c32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:00.494364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf04f31b-ee93-467a-8edf-bf9ac2d40c32 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Aug 22 19:38:00.494933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 616/1372] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:00 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:00.578334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f7820625-a37d-4eae-b49e-507580ee4eda tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:00.580538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f7820625-a37d-4eae-b49e-507580ee4eda tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:00.587106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7820625-a37d-4eae-b49e-507580ee4eda tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:00.587610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7820625-a37d-4eae-b49e-507580ee4eda tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:00.588070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7820625-a37d-4eae-b49e-507580ee4eda tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:00.588766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7820625-a37d-4eae-b49e-507580ee4eda tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:00.589209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7820625-a37d-4eae-b49e-507580ee4eda tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:00.589630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7820625-a37d-4eae-b49e-507580ee4eda tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:00.619690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f7820625-a37d-4eae-b49e-507580ee4eda tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Aug 22 19:38:00.620249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 757/1373] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:01.506557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4bab0fc-07b1-433e-aa53-0fa7d4ff0b41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:01.508715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4bab0fc-07b1-433e-aa53-0fa7d4ff0b41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:01.515261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4bab0fc-07b1-433e-aa53-0fa7d4ff0b41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:01.515773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4bab0fc-07b1-433e-aa53-0fa7d4ff0b41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:01.516205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4bab0fc-07b1-433e-aa53-0fa7d4ff0b41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:01.516899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4bab0fc-07b1-433e-aa53-0fa7d4ff0b41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:01.517352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4bab0fc-07b1-433e-aa53-0fa7d4ff0b41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:01.517776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4bab0fc-07b1-433e-aa53-0fa7d4ff0b41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:01.547912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4bab0fc-07b1-433e-aa53-0fa7d4ff0b41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045231 Aug 22 19:38:01.548487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 617/1374] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:01 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:01.632036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a00b8d18-4fff-4aa5-96c2-9af48da3e266 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:01.634368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a00b8d18-4fff-4aa5-96c2-9af48da3e266 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:01.640541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a00b8d18-4fff-4aa5-96c2-9af48da3e266 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:01.641012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a00b8d18-4fff-4aa5-96c2-9af48da3e266 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:01.641448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a00b8d18-4fff-4aa5-96c2-9af48da3e266 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:01.642163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a00b8d18-4fff-4aa5-96c2-9af48da3e266 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:01.642602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a00b8d18-4fff-4aa5-96c2-9af48da3e266 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:01.643014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a00b8d18-4fff-4aa5-96c2-9af48da3e266 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:01.673686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a00b8d18-4fff-4aa5-96c2-9af48da3e266 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045631 Aug 22 19:38:01.674253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 758/1375] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:02.560746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f153bfc8-1cb2-4294-8069-076f35c1fc5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:02.562919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f153bfc8-1cb2-4294-8069-076f35c1fc5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:02.569360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f153bfc8-1cb2-4294-8069-076f35c1fc5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:02.569841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f153bfc8-1cb2-4294-8069-076f35c1fc5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:02.570275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f153bfc8-1cb2-4294-8069-076f35c1fc5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:02.570973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f153bfc8-1cb2-4294-8069-076f35c1fc5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:02.571426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f153bfc8-1cb2-4294-8069-076f35c1fc5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:02.571875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f153bfc8-1cb2-4294-8069-076f35c1fc5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:02.602765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f153bfc8-1cb2-4294-8069-076f35c1fc5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045943 Aug 22 19:38:02.603358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 618/1376] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:02 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:02.685540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eadf658b-a3db-4045-8577-bc42691f8883 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:02.687725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eadf658b-a3db-4045-8577-bc42691f8883 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:02.694074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eadf658b-a3db-4045-8577-bc42691f8883 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:02.694553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eadf658b-a3db-4045-8577-bc42691f8883 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:02.695543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eadf658b-a3db-4045-8577-bc42691f8883 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:02.696306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eadf658b-a3db-4045-8577-bc42691f8883 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:02.696759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eadf658b-a3db-4045-8577-bc42691f8883 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:02.697184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eadf658b-a3db-4045-8577-bc42691f8883 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:02.727652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eadf658b-a3db-4045-8577-bc42691f8883 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Aug 22 19:38:02.728251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 759/1377] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:03.614477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-421451d7-a834-4e01-b583-9e40d8b9f915 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:03.616656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-421451d7-a834-4e01-b583-9e40d8b9f915 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:03.623150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-421451d7-a834-4e01-b583-9e40d8b9f915 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:03.623630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-421451d7-a834-4e01-b583-9e40d8b9f915 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:03.624099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-421451d7-a834-4e01-b583-9e40d8b9f915 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:03.624799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-421451d7-a834-4e01-b583-9e40d8b9f915 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:03.625251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-421451d7-a834-4e01-b583-9e40d8b9f915 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:03.625672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-421451d7-a834-4e01-b583-9e40d8b9f915 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:03.655925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-421451d7-a834-4e01-b583-9e40d8b9f915 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 Aug 22 19:38:03.656500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 619/1378] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:03 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:03.740318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ad8d17b-3718-46c6-9e3b-0aaac4424b75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:03.742459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7ad8d17b-3718-46c6-9e3b-0aaac4424b75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:03.749060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ad8d17b-3718-46c6-9e3b-0aaac4424b75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:03.749581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ad8d17b-3718-46c6-9e3b-0aaac4424b75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:03.750022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ad8d17b-3718-46c6-9e3b-0aaac4424b75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:03.750726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ad8d17b-3718-46c6-9e3b-0aaac4424b75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:03.751183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ad8d17b-3718-46c6-9e3b-0aaac4424b75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:03.751620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ad8d17b-3718-46c6-9e3b-0aaac4424b75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:03.783972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7ad8d17b-3718-46c6-9e3b-0aaac4424b75 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047568 Aug 22 19:38:03.784544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 760/1379] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:04.668000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be8b093f-8f08-4f86-8d2d-920f727ba506 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:04.670174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be8b093f-8f08-4f86-8d2d-920f727ba506 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:04.676495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8b093f-8f08-4f86-8d2d-920f727ba506 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:04.676975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8b093f-8f08-4f86-8d2d-920f727ba506 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:04.677408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8b093f-8f08-4f86-8d2d-920f727ba506 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:04.678094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8b093f-8f08-4f86-8d2d-920f727ba506 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:04.678545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8b093f-8f08-4f86-8d2d-920f727ba506 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:04.678970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8b093f-8f08-4f86-8d2d-920f727ba506 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:04.707994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be8b093f-8f08-4f86-8d2d-920f727ba506 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043888 Aug 22 19:38:04.708542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 620/1380] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:04 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:04.795518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-18cf2008-cc57-4757-95fc-c3b618a52184 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:04.797682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-18cf2008-cc57-4757-95fc-c3b618a52184 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:04.804064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18cf2008-cc57-4757-95fc-c3b618a52184 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:04.804548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18cf2008-cc57-4757-95fc-c3b618a52184 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:04.805484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18cf2008-cc57-4757-95fc-c3b618a52184 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:04.806178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18cf2008-cc57-4757-95fc-c3b618a52184 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:04.806635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18cf2008-cc57-4757-95fc-c3b618a52184 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:04.807059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18cf2008-cc57-4757-95fc-c3b618a52184 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:04.836002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-18cf2008-cc57-4757-95fc-c3b618a52184 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Aug 22 19:38:04.836546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 761/1381] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:05.720348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2565ec91-9519-4596-8f7b-48467e65912a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:05.722469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2565ec91-9519-4596-8f7b-48467e65912a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:05.728832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2565ec91-9519-4596-8f7b-48467e65912a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:05.729316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2565ec91-9519-4596-8f7b-48467e65912a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:05.729752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2565ec91-9519-4596-8f7b-48467e65912a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:05.730444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2565ec91-9519-4596-8f7b-48467e65912a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:05.730894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2565ec91-9519-4596-8f7b-48467e65912a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:05.731316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2565ec91-9519-4596-8f7b-48467e65912a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:05.760488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2565ec91-9519-4596-8f7b-48467e65912a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044145 Aug 22 19:38:05.761051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 621/1382] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:05 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:05.848181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-36f78c91-e0ef-4733-9ac5-11878e1a03db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:05.850229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-36f78c91-e0ef-4733-9ac5-11878e1a03db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:05.856626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36f78c91-e0ef-4733-9ac5-11878e1a03db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:05.857100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36f78c91-e0ef-4733-9ac5-11878e1a03db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:05.857529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36f78c91-e0ef-4733-9ac5-11878e1a03db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:05.858207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36f78c91-e0ef-4733-9ac5-11878e1a03db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:05.858651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36f78c91-e0ef-4733-9ac5-11878e1a03db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:05.859067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36f78c91-e0ef-4733-9ac5-11878e1a03db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:05.887266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-36f78c91-e0ef-4733-9ac5-11878e1a03db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Aug 22 19:38:05.887840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 762/1383] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:06.772273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-203504d7-d331-434a-aa8d-626e390d8d7f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:06.775069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-203504d7-d331-434a-aa8d-626e390d8d7f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:06.781559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203504d7-d331-434a-aa8d-626e390d8d7f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:06.782029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203504d7-d331-434a-aa8d-626e390d8d7f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:06.782467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203504d7-d331-434a-aa8d-626e390d8d7f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:06.783164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203504d7-d331-434a-aa8d-626e390d8d7f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:06.783620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203504d7-d331-434a-aa8d-626e390d8d7f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:06.784075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-203504d7-d331-434a-aa8d-626e390d8d7f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:06.812757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-203504d7-d331-434a-aa8d-626e390d8d7f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Aug 22 19:38:06.813302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 622/1384] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:06 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:06.898252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eea503c2-eb6a-4890-960a-d42e94f5649b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:06.900998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eea503c2-eb6a-4890-960a-d42e94f5649b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:06.907451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea503c2-eb6a-4890-960a-d42e94f5649b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:06.907962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea503c2-eb6a-4890-960a-d42e94f5649b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:06.908402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea503c2-eb6a-4890-960a-d42e94f5649b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:06.909093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea503c2-eb6a-4890-960a-d42e94f5649b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:06.909545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea503c2-eb6a-4890-960a-d42e94f5649b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:06.909970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eea503c2-eb6a-4890-960a-d42e94f5649b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:06.938453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eea503c2-eb6a-4890-960a-d42e94f5649b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Aug 22 19:38:06.939001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 763/1385] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:07.825054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-853e110d-685f-490a-a24e-165d4ae95eb0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:07.827167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-853e110d-685f-490a-a24e-165d4ae95eb0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:07.833503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-853e110d-685f-490a-a24e-165d4ae95eb0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:07.833984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-853e110d-685f-490a-a24e-165d4ae95eb0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:07.834412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-853e110d-685f-490a-a24e-165d4ae95eb0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:07.835093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-853e110d-685f-490a-a24e-165d4ae95eb0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:07.835541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-853e110d-685f-490a-a24e-165d4ae95eb0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:07.836739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-853e110d-685f-490a-a24e-165d4ae95eb0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:07.866703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-853e110d-685f-490a-a24e-165d4ae95eb0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Aug 22 19:38:07.867266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 623/1386] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:07 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:07.950903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-26a9913e-2c9d-4e40-a59c-a37b91ac9969 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:07.953068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-26a9913e-2c9d-4e40-a59c-a37b91ac9969 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:07.959366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26a9913e-2c9d-4e40-a59c-a37b91ac9969 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:07.959886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26a9913e-2c9d-4e40-a59c-a37b91ac9969 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:07.960318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26a9913e-2c9d-4e40-a59c-a37b91ac9969 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:07.961810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26a9913e-2c9d-4e40-a59c-a37b91ac9969 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:07.962262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26a9913e-2c9d-4e40-a59c-a37b91ac9969 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:07.962685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26a9913e-2c9d-4e40-a59c-a37b91ac9969 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:07.990333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-26a9913e-2c9d-4e40-a59c-a37b91ac9969 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043418 Aug 22 19:38:07.990867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 764/1387] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:38:08.878461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e89f4b1a-070b-4f01-9719-c399bc90fa01 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:08.880539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e89f4b1a-070b-4f01-9719-c399bc90fa01 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:08.887347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e89f4b1a-070b-4f01-9719-c399bc90fa01 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:08.887873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e89f4b1a-070b-4f01-9719-c399bc90fa01 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:08.888294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e89f4b1a-070b-4f01-9719-c399bc90fa01 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:08.888983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e89f4b1a-070b-4f01-9719-c399bc90fa01 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:08.889432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e89f4b1a-070b-4f01-9719-c399bc90fa01 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:08.889853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e89f4b1a-070b-4f01-9719-c399bc90fa01 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:09.002606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0809359e-28ae-4457-9331-f1358baeb7ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:09.004828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0809359e-28ae-4457-9331-f1358baeb7ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:09.012184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0809359e-28ae-4457-9331-f1358baeb7ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:09.012677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0809359e-28ae-4457-9331-f1358baeb7ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:09.013109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0809359e-28ae-4457-9331-f1358baeb7ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:09.013842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0809359e-28ae-4457-9331-f1358baeb7ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:09.014285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0809359e-28ae-4457-9331-f1358baeb7ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:09.014704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0809359e-28ae-4457-9331-f1358baeb7ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:09.042180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:38:09.047308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0809359e-28ae-4457-9331-f1358baeb7ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048701 Aug 22 19:38:09.048090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 765/1388] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:38:09.063487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e89f4b1a-070b-4f01-9719-c399bc90fa01 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189023 Aug 22 19:38:09.064058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 624/1389] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:08 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:10.059706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a6b9569b-09ec-4b68-bbe3-ef782b968478 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:10.061856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a6b9569b-09ec-4b68-bbe3-ef782b968478 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:10.068323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6b9569b-09ec-4b68-bbe3-ef782b968478 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:10.068895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6b9569b-09ec-4b68-bbe3-ef782b968478 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:10.069326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6b9569b-09ec-4b68-bbe3-ef782b968478 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:10.070012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6b9569b-09ec-4b68-bbe3-ef782b968478 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:10.070460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6b9569b-09ec-4b68-bbe3-ef782b968478 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:10.070876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6b9569b-09ec-4b68-bbe3-ef782b968478 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:10.076198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1fe272b-a413-4d3a-95df-df954d7249c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:10.078315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1fe272b-a413-4d3a-95df-df954d7249c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:10.084590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1fe272b-a413-4d3a-95df-df954d7249c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:10.085072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1fe272b-a413-4d3a-95df-df954d7249c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:10.085504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1fe272b-a413-4d3a-95df-df954d7249c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:10.086461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1fe272b-a413-4d3a-95df-df954d7249c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:10.086910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1fe272b-a413-4d3a-95df-df954d7249c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:10.087331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1fe272b-a413-4d3a-95df-df954d7249c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:10.090955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:38:10.101675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a6b9569b-09ec-4b68-bbe3-ef782b968478 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046533 Aug 22 19:38:10.102683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 766/1390] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:10.117347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1fe272b-a413-4d3a-95df-df954d7249c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045724 Aug 22 19:38:10.117892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 625/1391] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:38:11.114573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c3b8d985-d45f-44ac-a8cc-0d8fbe402765 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:11.116735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c3b8d985-d45f-44ac-a8cc-0d8fbe402765 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:11.123140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3b8d985-d45f-44ac-a8cc-0d8fbe402765 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:11.123606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3b8d985-d45f-44ac-a8cc-0d8fbe402765 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:11.124060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3b8d985-d45f-44ac-a8cc-0d8fbe402765 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:11.124751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3b8d985-d45f-44ac-a8cc-0d8fbe402765 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:11.125196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3b8d985-d45f-44ac-a8cc-0d8fbe402765 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:11.125616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c3b8d985-d45f-44ac-a8cc-0d8fbe402765 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:11.129722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b10fef06-f902-46d5-ac31-e2ce84a714de tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:11.131949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b10fef06-f902-46d5-ac31-e2ce84a714de tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:11.138623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b10fef06-f902-46d5-ac31-e2ce84a714de tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:11.139104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b10fef06-f902-46d5-ac31-e2ce84a714de tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:11.139536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b10fef06-f902-46d5-ac31-e2ce84a714de tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:11.140259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b10fef06-f902-46d5-ac31-e2ce84a714de tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:11.140713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b10fef06-f902-46d5-ac31-e2ce84a714de tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:11.141136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b10fef06-f902-46d5-ac31-e2ce84a714de tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:11.156224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c3b8d985-d45f-44ac-a8cc-0d8fbe402765 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Aug 22 19:38:11.156790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 767/1392] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:11.170464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b10fef06-f902-46d5-ac31-e2ce84a714de tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Aug 22 19:38:11.171002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 626/1393] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:11 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:38:12.168256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f7a13331-b0c0-49b3-a292-bc4ab70a092c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:12.170405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f7a13331-b0c0-49b3-a292-bc4ab70a092c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:12.177630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a13331-b0c0-49b3-a292-bc4ab70a092c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:12.178101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a13331-b0c0-49b3-a292-bc4ab70a092c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:12.178527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a13331-b0c0-49b3-a292-bc4ab70a092c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:12.179215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a13331-b0c0-49b3-a292-bc4ab70a092c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:12.179679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a13331-b0c0-49b3-a292-bc4ab70a092c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:12.180098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a13331-b0c0-49b3-a292-bc4ab70a092c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:12.182756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff29d6ee-b6d7-4ee9-b1d2-11469e93aa57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:12.184965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff29d6ee-b6d7-4ee9-b1d2-11469e93aa57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:12.191627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff29d6ee-b6d7-4ee9-b1d2-11469e93aa57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:12.192147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff29d6ee-b6d7-4ee9-b1d2-11469e93aa57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:12.192587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff29d6ee-b6d7-4ee9-b1d2-11469e93aa57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:12.193292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff29d6ee-b6d7-4ee9-b1d2-11469e93aa57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:12.193746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff29d6ee-b6d7-4ee9-b1d2-11469e93aa57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:12.194176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff29d6ee-b6d7-4ee9-b1d2-11469e93aa57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:12.211358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f7a13331-b0c0-49b3-a292-bc4ab70a092c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046860 Aug 22 19:38:12.211953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 768/1394] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:12.224245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff29d6ee-b6d7-4ee9-b1d2-11469e93aa57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045830 Aug 22 19:38:12.224794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 627/1395] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:12 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:38:13.223512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a7eef5c8-5886-4484-a244-6c97d363ab22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:13.225701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a7eef5c8-5886-4484-a244-6c97d363ab22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:13.232512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7eef5c8-5886-4484-a244-6c97d363ab22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:13.232993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7eef5c8-5886-4484-a244-6c97d363ab22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:13.233450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7eef5c8-5886-4484-a244-6c97d363ab22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:13.234137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7eef5c8-5886-4484-a244-6c97d363ab22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:13.234584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7eef5c8-5886-4484-a244-6c97d363ab22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:13.235008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7eef5c8-5886-4484-a244-6c97d363ab22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:13.236025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b7b8a51-a911-4531-8377-06ceb9ed128e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:13.238118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b7b8a51-a911-4531-8377-06ceb9ed128e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:13.244532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7b8a51-a911-4531-8377-06ceb9ed128e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:13.245019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7b8a51-a911-4531-8377-06ceb9ed128e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:13.245490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7b8a51-a911-4531-8377-06ceb9ed128e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:13.246166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7b8a51-a911-4531-8377-06ceb9ed128e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:13.246623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7b8a51-a911-4531-8377-06ceb9ed128e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:13.247143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b7b8a51-a911-4531-8377-06ceb9ed128e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:13.266519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a7eef5c8-5886-4484-a244-6c97d363ab22 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046872 Aug 22 19:38:13.267298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 769/1396] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:13.278442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b7b8a51-a911-4531-8377-06ceb9ed128e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Aug 22 19:38:13.278998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 628/1397] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:13 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:14.279051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-526b3611-25a9-46cd-8d89-2a7282606ef6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:14.281215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-526b3611-25a9-46cd-8d89-2a7282606ef6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:14.287625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-526b3611-25a9-46cd-8d89-2a7282606ef6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:14.288170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-526b3611-25a9-46cd-8d89-2a7282606ef6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:14.288607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-526b3611-25a9-46cd-8d89-2a7282606ef6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:14.289305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-526b3611-25a9-46cd-8d89-2a7282606ef6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:14.289758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-526b3611-25a9-46cd-8d89-2a7282606ef6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:14.290117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21c0efc8-def0-4200-b4ef-b33a70670cef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:38:14.290630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-526b3611-25a9-46cd-8d89-2a7282606ef6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:14.292266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21c0efc8-def0-4200-b4ef-b33a70670cef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:14.298295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21c0efc8-def0-4200-b4ef-b33a70670cef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:14.298778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21c0efc8-def0-4200-b4ef-b33a70670cef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:14.299215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21c0efc8-def0-4200-b4ef-b33a70670cef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:14.299940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21c0efc8-def0-4200-b4ef-b33a70670cef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:14.300395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21c0efc8-def0-4200-b4ef-b33a70670cef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:14.300816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21c0efc8-def0-4200-b4ef-b33a70670cef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:14.320489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-526b3611-25a9-46cd-8d89-2a7282606ef6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045960 Aug 22 19:38:14.321290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 770/1398] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:14.405355 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21c0efc8-def0-4200-b4ef-b33a70670cef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "POST /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/action" status: 200 len: 76474 microversion: 2.1 time: 0.118645 Aug 22 19:38:14.405936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 629/1399] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:38:14 2022] POST /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8/action => generated 76474 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 19:38:15.333657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cf3249ce-50ec-4cc8-bb7d-0fba56277f40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:15.336117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cf3249ce-50ec-4cc8-bb7d-0fba56277f40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:15.338438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=58 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:38:15.343513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3249ce-50ec-4cc8-bb7d-0fba56277f40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:15.344030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3249ce-50ec-4cc8-bb7d-0fba56277f40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:15.344464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3249ce-50ec-4cc8-bb7d-0fba56277f40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:15.345153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3249ce-50ec-4cc8-bb7d-0fba56277f40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:15.345607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3249ce-50ec-4cc8-bb7d-0fba56277f40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:15.346026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3249ce-50ec-4cc8-bb7d-0fba56277f40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:15.374971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cf3249ce-50ec-4cc8-bb7d-0fba56277f40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Aug 22 19:38:15.375529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 771/1400] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:15 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:16.388342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aff3de4c-5024-4577-b47a-936ab48e0845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:16.390605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aff3de4c-5024-4577-b47a-936ab48e0845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:16.393033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=58 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:38:16.399128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aff3de4c-5024-4577-b47a-936ab48e0845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:16.399562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aff3de4c-5024-4577-b47a-936ab48e0845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:16.400665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aff3de4c-5024-4577-b47a-936ab48e0845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:16.401401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aff3de4c-5024-4577-b47a-936ab48e0845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:16.401860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aff3de4c-5024-4577-b47a-936ab48e0845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:16.402290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aff3de4c-5024-4577-b47a-936ab48e0845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:16.434842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aff3de4c-5024-4577-b47a-936ab48e0845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051380 Aug 22 19:38:16.435388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 630/1401] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:17.447770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b09b6f40-08d5-4bd8-9b6a-c3acfbf07666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:17.450687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b09b6f40-08d5-4bd8-9b6a-c3acfbf07666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:17.459860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09b6f40-08d5-4bd8-9b6a-c3acfbf07666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:17.460347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09b6f40-08d5-4bd8-9b6a-c3acfbf07666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:17.461042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09b6f40-08d5-4bd8-9b6a-c3acfbf07666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:17.461742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09b6f40-08d5-4bd8-9b6a-c3acfbf07666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:17.462866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09b6f40-08d5-4bd8-9b6a-c3acfbf07666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:17.463335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09b6f40-08d5-4bd8-9b6a-c3acfbf07666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:17.493650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b09b6f40-08d5-4bd8-9b6a-c3acfbf07666 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050390 Aug 22 19:38:17.494261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 772/1402] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:18.506489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb8e95e9-5583-432b-a3af-5842c7a10574 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:18.508768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb8e95e9-5583-432b-a3af-5842c7a10574 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:18.519297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb8e95e9-5583-432b-a3af-5842c7a10574 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:18.519897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb8e95e9-5583-432b-a3af-5842c7a10574 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:18.520409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb8e95e9-5583-432b-a3af-5842c7a10574 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:18.521105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb8e95e9-5583-432b-a3af-5842c7a10574 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:18.521552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb8e95e9-5583-432b-a3af-5842c7a10574 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:18.521972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb8e95e9-5583-432b-a3af-5842c7a10574 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:18.551306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb8e95e9-5583-432b-a3af-5842c7a10574 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048855 Aug 22 19:38:18.551942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 631/1403] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:19.563588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e520c6d6-7fb3-4830-8f5a-48db398202ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:19.565804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e520c6d6-7fb3-4830-8f5a-48db398202ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:19.572173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e520c6d6-7fb3-4830-8f5a-48db398202ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:19.572722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e520c6d6-7fb3-4830-8f5a-48db398202ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:19.573162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e520c6d6-7fb3-4830-8f5a-48db398202ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:19.573894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e520c6d6-7fb3-4830-8f5a-48db398202ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:19.574346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e520c6d6-7fb3-4830-8f5a-48db398202ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:19.574769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e520c6d6-7fb3-4830-8f5a-48db398202ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:19.603979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e520c6d6-7fb3-4830-8f5a-48db398202ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Aug 22 19:38:19.604533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 773/1404] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:20.616693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e85588c9-f83f-43f5-afd7-ef4200aedcfe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:20.618937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e85588c9-f83f-43f5-afd7-ef4200aedcfe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:20.625368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e85588c9-f83f-43f5-afd7-ef4200aedcfe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:20.625860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e85588c9-f83f-43f5-afd7-ef4200aedcfe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:20.626292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e85588c9-f83f-43f5-afd7-ef4200aedcfe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:20.627015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e85588c9-f83f-43f5-afd7-ef4200aedcfe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:20.627466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e85588c9-f83f-43f5-afd7-ef4200aedcfe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:20.627919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e85588c9-f83f-43f5-afd7-ef4200aedcfe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:20.657303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e85588c9-f83f-43f5-afd7-ef4200aedcfe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Aug 22 19:38:20.657823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 632/1405] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:21.669493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1d08ffbc-4bc6-4f1e-8bb9-2e4ee1cde25e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:21.671900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1d08ffbc-4bc6-4f1e-8bb9-2e4ee1cde25e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:21.678379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d08ffbc-4bc6-4f1e-8bb9-2e4ee1cde25e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:21.678888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d08ffbc-4bc6-4f1e-8bb9-2e4ee1cde25e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:21.679313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d08ffbc-4bc6-4f1e-8bb9-2e4ee1cde25e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:21.680034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d08ffbc-4bc6-4f1e-8bb9-2e4ee1cde25e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:21.680480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d08ffbc-4bc6-4f1e-8bb9-2e4ee1cde25e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:21.680942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d08ffbc-4bc6-4f1e-8bb9-2e4ee1cde25e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:21.712183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1d08ffbc-4bc6-4f1e-8bb9-2e4ee1cde25e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046719 Aug 22 19:38:21.712738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 774/1406] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:22.724711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92aacb2b-49d9-43ec-a169-c9c7a0110b0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:22.726857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92aacb2b-49d9-43ec-a169-c9c7a0110b0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:22.734006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92aacb2b-49d9-43ec-a169-c9c7a0110b0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:22.734494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92aacb2b-49d9-43ec-a169-c9c7a0110b0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:22.734928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92aacb2b-49d9-43ec-a169-c9c7a0110b0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:22.735632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92aacb2b-49d9-43ec-a169-c9c7a0110b0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:22.736111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92aacb2b-49d9-43ec-a169-c9c7a0110b0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:22.736545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92aacb2b-49d9-43ec-a169-c9c7a0110b0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:22.766396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92aacb2b-49d9-43ec-a169-c9c7a0110b0d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045525 Aug 22 19:38:22.766945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 633/1407] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:23.778357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4a594a75-2426-47d1-bcbf-ca08f3a3fa5b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:23.780578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4a594a75-2426-47d1-bcbf-ca08f3a3fa5b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:23.786770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a594a75-2426-47d1-bcbf-ca08f3a3fa5b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:23.787243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a594a75-2426-47d1-bcbf-ca08f3a3fa5b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:23.787691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a594a75-2426-47d1-bcbf-ca08f3a3fa5b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:23.788379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a594a75-2426-47d1-bcbf-ca08f3a3fa5b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:23.788823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a594a75-2426-47d1-bcbf-ca08f3a3fa5b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:23.789243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a594a75-2426-47d1-bcbf-ca08f3a3fa5b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:23.818731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4a594a75-2426-47d1-bcbf-ca08f3a3fa5b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Aug 22 19:38:23.819279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 775/1408] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:24.830485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf2878e5-7f09-4037-bf32-2c4de8985169 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:24.832651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf2878e5-7f09-4037-bf32-2c4de8985169 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:24.839194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2878e5-7f09-4037-bf32-2c4de8985169 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:24.840208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2878e5-7f09-4037-bf32-2c4de8985169 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:24.840647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2878e5-7f09-4037-bf32-2c4de8985169 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:24.841345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2878e5-7f09-4037-bf32-2c4de8985169 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:24.841794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2878e5-7f09-4037-bf32-2c4de8985169 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:24.842223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2878e5-7f09-4037-bf32-2c4de8985169 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:24.871617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf2878e5-7f09-4037-bf32-2c4de8985169 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Aug 22 19:38:24.872188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 634/1409] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:24.924727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:38:24.924972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:38:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:38:25.883905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4611ae2e-21b9-4039-b2f9-4e6e76dad75f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:25.886057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4611ae2e-21b9-4039-b2f9-4e6e76dad75f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:25.893277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4611ae2e-21b9-4039-b2f9-4e6e76dad75f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:25.893763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4611ae2e-21b9-4039-b2f9-4e6e76dad75f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:25.894196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4611ae2e-21b9-4039-b2f9-4e6e76dad75f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:25.894902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4611ae2e-21b9-4039-b2f9-4e6e76dad75f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:25.895358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4611ae2e-21b9-4039-b2f9-4e6e76dad75f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:25.895817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4611ae2e-21b9-4039-b2f9-4e6e76dad75f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:25.928223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4611ae2e-21b9-4039-b2f9-4e6e76dad75f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Aug 22 19:38:25.928934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 776/1410] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:26.940720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec6f3555-dd4f-43b0-9c86-50b6c0d25207 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:26.942846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec6f3555-dd4f-43b0-9c86-50b6c0d25207 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:26.949798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6f3555-dd4f-43b0-9c86-50b6c0d25207 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:26.950281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6f3555-dd4f-43b0-9c86-50b6c0d25207 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:26.950719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6f3555-dd4f-43b0-9c86-50b6c0d25207 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:26.951416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6f3555-dd4f-43b0-9c86-50b6c0d25207 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:26.951902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6f3555-dd4f-43b0-9c86-50b6c0d25207 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:26.952327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6f3555-dd4f-43b0-9c86-50b6c0d25207 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:26.981651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec6f3555-dd4f-43b0-9c86-50b6c0d25207 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Aug 22 19:38:26.982200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 635/1411] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:27.993872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a1960ee8-5e55-4912-94e4-643f7dc99c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:27.996571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a1960ee8-5e55-4912-94e4-643f7dc99c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:28.003047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1960ee8-5e55-4912-94e4-643f7dc99c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:28.003531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1960ee8-5e55-4912-94e4-643f7dc99c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:28.003993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1960ee8-5e55-4912-94e4-643f7dc99c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:28.004693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1960ee8-5e55-4912-94e4-643f7dc99c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:28.005152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1960ee8-5e55-4912-94e4-643f7dc99c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:28.005561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1960ee8-5e55-4912-94e4-643f7dc99c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:28.034789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a1960ee8-5e55-4912-94e4-643f7dc99c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Aug 22 19:38:28.035344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 777/1412] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:27 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:28.274761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:38:28.275261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:38:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:38:29.047462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fdc8cf6a-6103-472b-b80f-f419eecf5f6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:29.049594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fdc8cf6a-6103-472b-b80f-f419eecf5f6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:29.056540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdc8cf6a-6103-472b-b80f-f419eecf5f6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:29.057272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdc8cf6a-6103-472b-b80f-f419eecf5f6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:29.057699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdc8cf6a-6103-472b-b80f-f419eecf5f6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:29.058487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdc8cf6a-6103-472b-b80f-f419eecf5f6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:29.058828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdc8cf6a-6103-472b-b80f-f419eecf5f6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:29.059251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdc8cf6a-6103-472b-b80f-f419eecf5f6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:29.089601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fdc8cf6a-6103-472b-b80f-f419eecf5f6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046569 Aug 22 19:38:29.090154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 636/1413] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:29 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:30.101905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-75540eda-7da5-49b5-bc32-4047498c18ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:30.104159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-75540eda-7da5-49b5-bc32-4047498c18ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:30.113137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75540eda-7da5-49b5-bc32-4047498c18ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:30.113617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75540eda-7da5-49b5-bc32-4047498c18ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:30.114052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75540eda-7da5-49b5-bc32-4047498c18ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:30.114753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75540eda-7da5-49b5-bc32-4047498c18ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:30.115193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75540eda-7da5-49b5-bc32-4047498c18ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:30.115613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75540eda-7da5-49b5-bc32-4047498c18ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:30.144877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-75540eda-7da5-49b5-bc32-4047498c18ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 Aug 22 19:38:30.145877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 778/1414] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:31.158392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e23e995-5b8a-43a9-8c2d-3b184a0c88fe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:31.160941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e23e995-5b8a-43a9-8c2d-3b184a0c88fe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:31.172170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e23e995-5b8a-43a9-8c2d-3b184a0c88fe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:31.172650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e23e995-5b8a-43a9-8c2d-3b184a0c88fe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:31.173140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e23e995-5b8a-43a9-8c2d-3b184a0c88fe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:31.173881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e23e995-5b8a-43a9-8c2d-3b184a0c88fe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:31.174333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e23e995-5b8a-43a9-8c2d-3b184a0c88fe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:31.174757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e23e995-5b8a-43a9-8c2d-3b184a0c88fe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:31.204099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e23e995-5b8a-43a9-8c2d-3b184a0c88fe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050530 Aug 22 19:38:31.204658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 637/1415] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:32.216734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6c8e970f-4197-4fe8-aa19-d5399c0d810f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:32.219381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6c8e970f-4197-4fe8-aa19-d5399c0d810f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:32.225289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c8e970f-4197-4fe8-aa19-d5399c0d810f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:32.225767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c8e970f-4197-4fe8-aa19-d5399c0d810f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:32.226199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c8e970f-4197-4fe8-aa19-d5399c0d810f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:32.226884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c8e970f-4197-4fe8-aa19-d5399c0d810f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:32.227383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c8e970f-4197-4fe8-aa19-d5399c0d810f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:32.227778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c8e970f-4197-4fe8-aa19-d5399c0d810f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:32.257723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6c8e970f-4197-4fe8-aa19-d5399c0d810f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Aug 22 19:38:32.258288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 779/1416] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:33.270026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e87604e7-fc59-4b03-9a3c-41dfd06cf559 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:33.272350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e87604e7-fc59-4b03-9a3c-41dfd06cf559 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:33.279092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e87604e7-fc59-4b03-9a3c-41dfd06cf559 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:33.279567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e87604e7-fc59-4b03-9a3c-41dfd06cf559 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:33.280624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e87604e7-fc59-4b03-9a3c-41dfd06cf559 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:33.281304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e87604e7-fc59-4b03-9a3c-41dfd06cf559 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:33.281753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e87604e7-fc59-4b03-9a3c-41dfd06cf559 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:33.282173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e87604e7-fc59-4b03-9a3c-41dfd06cf559 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:33.314962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e87604e7-fc59-4b03-9a3c-41dfd06cf559 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048808 Aug 22 19:38:33.315386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 638/1417] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:34.327503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4ac08087-5400-4624-b87a-4ee4af84b27a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:34.329664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4ac08087-5400-4624-b87a-4ee4af84b27a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:34.336337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ac08087-5400-4624-b87a-4ee4af84b27a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:34.336814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ac08087-5400-4624-b87a-4ee4af84b27a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:34.337244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ac08087-5400-4624-b87a-4ee4af84b27a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:34.337935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ac08087-5400-4624-b87a-4ee4af84b27a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:34.338384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ac08087-5400-4624-b87a-4ee4af84b27a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:34.338810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ac08087-5400-4624-b87a-4ee4af84b27a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:34.368083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4ac08087-5400-4624-b87a-4ee4af84b27a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 Aug 22 19:38:34.368662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 780/1418] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:34 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:35.380668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-392babb9-f094-4710-93b3-647f37a15e5c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:35.382802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-392babb9-f094-4710-93b3-647f37a15e5c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:35.389971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-392babb9-f094-4710-93b3-647f37a15e5c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:35.390458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-392babb9-f094-4710-93b3-647f37a15e5c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:35.390897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-392babb9-f094-4710-93b3-647f37a15e5c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:35.391595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-392babb9-f094-4710-93b3-647f37a15e5c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:35.392137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-392babb9-f094-4710-93b3-647f37a15e5c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:35.392569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-392babb9-f094-4710-93b3-647f37a15e5c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:35.423309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-392babb9-f094-4710-93b3-647f37a15e5c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046556 Aug 22 19:38:35.423902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 639/1419] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:36.436727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2c869b24-097b-4769-92ef-5f57a03c535c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:36.438955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2c869b24-097b-4769-92ef-5f57a03c535c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:36.445826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c869b24-097b-4769-92ef-5f57a03c535c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:36.446316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c869b24-097b-4769-92ef-5f57a03c535c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:36.446758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c869b24-097b-4769-92ef-5f57a03c535c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:36.447472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c869b24-097b-4769-92ef-5f57a03c535c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:36.447962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c869b24-097b-4769-92ef-5f57a03c535c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:36.448390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c869b24-097b-4769-92ef-5f57a03c535c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:36.482428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2c869b24-097b-4769-92ef-5f57a03c535c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050341 Aug 22 19:38:36.483720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 781/1420] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:37.494502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85ede0e7-feb4-4e8d-8f50-089c767e3c38 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:37.496653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85ede0e7-feb4-4e8d-8f50-089c767e3c38 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:37.503002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85ede0e7-feb4-4e8d-8f50-089c767e3c38 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:37.503478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85ede0e7-feb4-4e8d-8f50-089c767e3c38 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:37.503950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85ede0e7-feb4-4e8d-8f50-089c767e3c38 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:37.504642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85ede0e7-feb4-4e8d-8f50-089c767e3c38 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:37.505092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85ede0e7-feb4-4e8d-8f50-089c767e3c38 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:37.505513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85ede0e7-feb4-4e8d-8f50-089c767e3c38 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:37.535031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85ede0e7-feb4-4e8d-8f50-089c767e3c38 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Aug 22 19:38:37.535581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 640/1421] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:38.547672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-62459eb3-5695-44c5-b6e2-4bc4c814d29f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:38.549835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-62459eb3-5695-44c5-b6e2-4bc4c814d29f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:38.556309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62459eb3-5695-44c5-b6e2-4bc4c814d29f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:38.556786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62459eb3-5695-44c5-b6e2-4bc4c814d29f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:38.557219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62459eb3-5695-44c5-b6e2-4bc4c814d29f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:38.557903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62459eb3-5695-44c5-b6e2-4bc4c814d29f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:38.558353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62459eb3-5695-44c5-b6e2-4bc4c814d29f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:38.558773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-62459eb3-5695-44c5-b6e2-4bc4c814d29f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:38.575229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:38:38.588576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-62459eb3-5695-44c5-b6e2-4bc4c814d29f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045361 Aug 22 19:38:38.589145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 782/1422] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:39.600716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24e338d3-3c56-4227-8743-8c164a6598c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:39.602876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24e338d3-3c56-4227-8743-8c164a6598c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:39.609338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e338d3-3c56-4227-8743-8c164a6598c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:39.609816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e338d3-3c56-4227-8743-8c164a6598c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:39.610249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e338d3-3c56-4227-8743-8c164a6598c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:39.610936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e338d3-3c56-4227-8743-8c164a6598c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:39.611387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e338d3-3c56-4227-8743-8c164a6598c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:39.611856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24e338d3-3c56-4227-8743-8c164a6598c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:39.641069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24e338d3-3c56-4227-8743-8c164a6598c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Aug 22 19:38:39.641800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 641/1423] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:40.653085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-96a05f09-7e0d-436f-94ba-65d44cf2aca7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:40.655726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-96a05f09-7e0d-436f-94ba-65d44cf2aca7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:40.662435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96a05f09-7e0d-436f-94ba-65d44cf2aca7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:40.662908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96a05f09-7e0d-436f-94ba-65d44cf2aca7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:40.663336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96a05f09-7e0d-436f-94ba-65d44cf2aca7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:40.664055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96a05f09-7e0d-436f-94ba-65d44cf2aca7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:40.664504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96a05f09-7e0d-436f-94ba-65d44cf2aca7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:40.664923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96a05f09-7e0d-436f-94ba-65d44cf2aca7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:40.696659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-96a05f09-7e0d-436f-94ba-65d44cf2aca7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Aug 22 19:38:40.697236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 783/1424] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:41.709305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df311207-eacd-40b9-acad-a7e8666a2188 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:41.711893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-df311207-eacd-40b9-acad-a7e8666a2188 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:41.718025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df311207-eacd-40b9-acad-a7e8666a2188 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:41.719117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df311207-eacd-40b9-acad-a7e8666a2188 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:41.719542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df311207-eacd-40b9-acad-a7e8666a2188 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:41.720250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df311207-eacd-40b9-acad-a7e8666a2188 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:41.720692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df311207-eacd-40b9-acad-a7e8666a2188 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:41.721374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df311207-eacd-40b9-acad-a7e8666a2188 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:41.723428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=99 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:38:41.750197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df311207-eacd-40b9-acad-a7e8666a2188 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044860 Aug 22 19:38:41.750735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 642/1425] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:42.761443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-19c0d583-8f14-46a8-ada9-81ee29ae36ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:42.763571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-19c0d583-8f14-46a8-ada9-81ee29ae36ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:42.770314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19c0d583-8f14-46a8-ada9-81ee29ae36ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:42.770837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19c0d583-8f14-46a8-ada9-81ee29ae36ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:42.771363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19c0d583-8f14-46a8-ada9-81ee29ae36ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:42.772151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19c0d583-8f14-46a8-ada9-81ee29ae36ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:42.772610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19c0d583-8f14-46a8-ada9-81ee29ae36ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:42.773161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19c0d583-8f14-46a8-ada9-81ee29ae36ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:42.803461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-19c0d583-8f14-46a8-ada9-81ee29ae36ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Aug 22 19:38:42.804053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 784/1426] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:43.816618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc45382c-309d-42de-b271-fe34b63485c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:43.818743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc45382c-309d-42de-b271-fe34b63485c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:43.824985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc45382c-309d-42de-b271-fe34b63485c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:43.825503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc45382c-309d-42de-b271-fe34b63485c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:43.825938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc45382c-309d-42de-b271-fe34b63485c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:43.826634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc45382c-309d-42de-b271-fe34b63485c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:43.827083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc45382c-309d-42de-b271-fe34b63485c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:43.827591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc45382c-309d-42de-b271-fe34b63485c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:43.855872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc45382c-309d-42de-b271-fe34b63485c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Aug 22 19:38:43.856408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 643/1427] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:43 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:44.599836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 22 19:38:44.600403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:38:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:38:44.868659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a6411680-93d2-4b79-8eed-82e8f16f3c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:44.870685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a6411680-93d2-4b79-8eed-82e8f16f3c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:44.877765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6411680-93d2-4b79-8eed-82e8f16f3c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:44.878255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6411680-93d2-4b79-8eed-82e8f16f3c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:44.878668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6411680-93d2-4b79-8eed-82e8f16f3c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:44.879351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6411680-93d2-4b79-8eed-82e8f16f3c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:44.879825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6411680-93d2-4b79-8eed-82e8f16f3c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:44.880246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6411680-93d2-4b79-8eed-82e8f16f3c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:44.907979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a6411680-93d2-4b79-8eed-82e8f16f3c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 Aug 22 19:38:44.908506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 785/1428] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:45.920118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ae669d7-a6cc-4f46-948b-11abceb1e199 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:45.922288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ae669d7-a6cc-4f46-948b-11abceb1e199 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:45.928535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ae669d7-a6cc-4f46-948b-11abceb1e199 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:45.929009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ae669d7-a6cc-4f46-948b-11abceb1e199 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:45.929440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ae669d7-a6cc-4f46-948b-11abceb1e199 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:45.930122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ae669d7-a6cc-4f46-948b-11abceb1e199 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:45.930567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ae669d7-a6cc-4f46-948b-11abceb1e199 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:45.930984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ae669d7-a6cc-4f46-948b-11abceb1e199 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:45.959993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ae669d7-a6cc-4f46-948b-11abceb1e199 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Aug 22 19:38:45.960529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 644/1429] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:46.972177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-69c35881-6781-4d14-94dc-cb1f121cd3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:46.974370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-69c35881-6781-4d14-94dc-cb1f121cd3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:46.976704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=30 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:38:46.981932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69c35881-6781-4d14-94dc-cb1f121cd3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:46.982433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69c35881-6781-4d14-94dc-cb1f121cd3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:46.982871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69c35881-6781-4d14-94dc-cb1f121cd3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:46.983561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69c35881-6781-4d14-94dc-cb1f121cd3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:46.984560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69c35881-6781-4d14-94dc-cb1f121cd3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:46.984985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69c35881-6781-4d14-94dc-cb1f121cd3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:47.013950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-69c35881-6781-4d14-94dc-cb1f121cd3ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Aug 22 19:38:47.014529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 786/1430] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:48.026163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4aa28602-04df-4526-a9a4-080e86827f87 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:48.028352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4aa28602-04df-4526-a9a4-080e86827f87 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:48.030664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:38:48.036015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa28602-04df-4526-a9a4-080e86827f87 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:48.036598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa28602-04df-4526-a9a4-080e86827f87 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:48.037031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa28602-04df-4526-a9a4-080e86827f87 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:48.037718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa28602-04df-4526-a9a4-080e86827f87 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:48.038158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa28602-04df-4526-a9a4-080e86827f87 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:48.038574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa28602-04df-4526-a9a4-080e86827f87 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:48.069731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4aa28602-04df-4526-a9a4-080e86827f87 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047478 Aug 22 19:38:48.070292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 645/1431] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:49.081972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c52220ee-261a-4b98-ab25-14c385896662 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:49.084119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c52220ee-261a-4b98-ab25-14c385896662 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:49.090830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52220ee-261a-4b98-ab25-14c385896662 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:49.091302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52220ee-261a-4b98-ab25-14c385896662 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:49.091760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52220ee-261a-4b98-ab25-14c385896662 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:49.092442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52220ee-261a-4b98-ab25-14c385896662 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:49.092886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52220ee-261a-4b98-ab25-14c385896662 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:49.093300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c52220ee-261a-4b98-ab25-14c385896662 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:49.122009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c52220ee-261a-4b98-ab25-14c385896662 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Aug 22 19:38:49.122645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 787/1432] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:50.134449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc479064-d2a4-48f9-a3d9-4b1e815fd4cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:50.136689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc479064-d2a4-48f9-a3d9-4b1e815fd4cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:50.143777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc479064-d2a4-48f9-a3d9-4b1e815fd4cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:50.144261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc479064-d2a4-48f9-a3d9-4b1e815fd4cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:50.144696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc479064-d2a4-48f9-a3d9-4b1e815fd4cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:50.145395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc479064-d2a4-48f9-a3d9-4b1e815fd4cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:50.145853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc479064-d2a4-48f9-a3d9-4b1e815fd4cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:50.146284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc479064-d2a4-48f9-a3d9-4b1e815fd4cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:50.174415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc479064-d2a4-48f9-a3d9-4b1e815fd4cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043949 Aug 22 19:38:50.174954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 646/1433] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:51.186512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bf51ba62-a868-4ca8-bcce-25a2bc87e8cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:51.189175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bf51ba62-a868-4ca8-bcce-25a2bc87e8cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:51.195545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf51ba62-a868-4ca8-bcce-25a2bc87e8cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:51.196084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf51ba62-a868-4ca8-bcce-25a2bc87e8cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:51.196541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf51ba62-a868-4ca8-bcce-25a2bc87e8cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:51.197214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf51ba62-a868-4ca8-bcce-25a2bc87e8cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:51.197665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf51ba62-a868-4ca8-bcce-25a2bc87e8cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:51.198089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf51ba62-a868-4ca8-bcce-25a2bc87e8cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:51.226744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bf51ba62-a868-4ca8-bcce-25a2bc87e8cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Aug 22 19:38:51.227287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 788/1434] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:52.238443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07aefbd5-b1cd-4753-847f-e96b268dcd54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:52.240608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07aefbd5-b1cd-4753-847f-e96b268dcd54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:52.246877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aefbd5-b1cd-4753-847f-e96b268dcd54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:52.247354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aefbd5-b1cd-4753-847f-e96b268dcd54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:52.247826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aefbd5-b1cd-4753-847f-e96b268dcd54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:52.248521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aefbd5-b1cd-4753-847f-e96b268dcd54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:52.248970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aefbd5-b1cd-4753-847f-e96b268dcd54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:52.249390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aefbd5-b1cd-4753-847f-e96b268dcd54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:52.278087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07aefbd5-b1cd-4753-847f-e96b268dcd54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Aug 22 19:38:52.278645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 647/1435] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:53.291080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e62c2f7d-3a87-4941-82e5-fe0a7e23e2e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:53.293315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e62c2f7d-3a87-4941-82e5-fe0a7e23e2e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:53.300490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e62c2f7d-3a87-4941-82e5-fe0a7e23e2e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:53.300975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e62c2f7d-3a87-4941-82e5-fe0a7e23e2e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:53.301410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e62c2f7d-3a87-4941-82e5-fe0a7e23e2e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:53.302123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e62c2f7d-3a87-4941-82e5-fe0a7e23e2e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:53.302581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e62c2f7d-3a87-4941-82e5-fe0a7e23e2e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:53.303007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e62c2f7d-3a87-4941-82e5-fe0a7e23e2e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:53.333986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e62c2f7d-3a87-4941-82e5-fe0a7e23e2e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046872 Aug 22 19:38:53.334551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 789/1436] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:54.347160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a2425c7-a2cc-4e92-80a2-d0348683bbec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:54.349332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0a2425c7-a2cc-4e92-80a2-d0348683bbec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:54.356010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2425c7-a2cc-4e92-80a2-d0348683bbec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:54.356491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2425c7-a2cc-4e92-80a2-d0348683bbec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:54.356928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2425c7-a2cc-4e92-80a2-d0348683bbec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:54.357621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2425c7-a2cc-4e92-80a2-d0348683bbec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:54.358074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2425c7-a2cc-4e92-80a2-d0348683bbec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:54.358502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a2425c7-a2cc-4e92-80a2-d0348683bbec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:54.386515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a2425c7-a2cc-4e92-80a2-d0348683bbec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Aug 22 19:38:54.387056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 648/1437] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:55.398556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d8028fb1-af61-42ca-9b5e-9e90395e851e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:55.400618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d8028fb1-af61-42ca-9b5e-9e90395e851e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:55.407393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8028fb1-af61-42ca-9b5e-9e90395e851e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:55.407892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8028fb1-af61-42ca-9b5e-9e90395e851e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:55.408322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8028fb1-af61-42ca-9b5e-9e90395e851e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:55.409032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8028fb1-af61-42ca-9b5e-9e90395e851e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:55.409475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8028fb1-af61-42ca-9b5e-9e90395e851e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:55.409889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8028fb1-af61-42ca-9b5e-9e90395e851e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:55.438265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d8028fb1-af61-42ca-9b5e-9e90395e851e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043774 Aug 22 19:38:55.438812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 790/1438] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:56.450540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b54d7949-7c07-4d94-8481-73e4200b4a5e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:56.453261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b54d7949-7c07-4d94-8481-73e4200b4a5e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:56.460279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b54d7949-7c07-4d94-8481-73e4200b4a5e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:56.460752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b54d7949-7c07-4d94-8481-73e4200b4a5e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:56.461178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b54d7949-7c07-4d94-8481-73e4200b4a5e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:56.461863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b54d7949-7c07-4d94-8481-73e4200b4a5e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:56.462308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b54d7949-7c07-4d94-8481-73e4200b4a5e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:56.462726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b54d7949-7c07-4d94-8481-73e4200b4a5e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:56.491670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b54d7949-7c07-4d94-8481-73e4200b4a5e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Aug 22 19:38:56.492228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 649/1439] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:57.504554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-41aad929-50be-4abb-8c90-927215a1dee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:57.506687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-41aad929-50be-4abb-8c90-927215a1dee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:57.513044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41aad929-50be-4abb-8c90-927215a1dee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:57.513522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41aad929-50be-4abb-8c90-927215a1dee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:57.513956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41aad929-50be-4abb-8c90-927215a1dee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:57.514650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41aad929-50be-4abb-8c90-927215a1dee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:57.515099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41aad929-50be-4abb-8c90-927215a1dee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:57.515520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41aad929-50be-4abb-8c90-927215a1dee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:57.543635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-41aad929-50be-4abb-8c90-927215a1dee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043056 Aug 22 19:38:57.544205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 791/1440] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:58.556123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4852606c-65d6-45d7-86b7-d337ee64221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:58.558255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4852606c-65d6-45d7-86b7-d337ee64221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:58.564336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4852606c-65d6-45d7-86b7-d337ee64221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:58.564811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4852606c-65d6-45d7-86b7-d337ee64221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:58.565241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4852606c-65d6-45d7-86b7-d337ee64221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:58.565953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4852606c-65d6-45d7-86b7-d337ee64221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:58.566399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4852606c-65d6-45d7-86b7-d337ee64221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:58.566814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4852606c-65d6-45d7-86b7-d337ee64221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:58.595150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4852606c-65d6-45d7-86b7-d337ee64221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 Aug 22 19:38:58.595701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 650/1441] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:38:59.607290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d9881541-16b6-45df-96d7-c3b006cff82a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:38:59.609953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d9881541-16b6-45df-96d7-c3b006cff82a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:38:59.616428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d9881541-16b6-45df-96d7-c3b006cff82a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:59.616902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d9881541-16b6-45df-96d7-c3b006cff82a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:59.617330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d9881541-16b6-45df-96d7-c3b006cff82a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:59.618010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d9881541-16b6-45df-96d7-c3b006cff82a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:38:59.618454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d9881541-16b6-45df-96d7-c3b006cff82a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:38:59.618869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d9881541-16b6-45df-96d7-c3b006cff82a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:38:59.647249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d9881541-16b6-45df-96d7-c3b006cff82a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Aug 22 19:38:59.647820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 792/1442] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:38:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:00.660457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-591e1f3b-9167-4d52-a25b-98dec32b52d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:00.662580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-591e1f3b-9167-4d52-a25b-98dec32b52d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:00.669009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-591e1f3b-9167-4d52-a25b-98dec32b52d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:00.669494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-591e1f3b-9167-4d52-a25b-98dec32b52d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:00.669924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-591e1f3b-9167-4d52-a25b-98dec32b52d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:00.670611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-591e1f3b-9167-4d52-a25b-98dec32b52d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:00.671752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-591e1f3b-9167-4d52-a25b-98dec32b52d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:00.672173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-591e1f3b-9167-4d52-a25b-98dec32b52d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:00.700917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-591e1f3b-9167-4d52-a25b-98dec32b52d2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044390 Aug 22 19:39:00.701463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 651/1443] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:01.713074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1b6c752d-d2a8-42d1-be11-3afaf2531335 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:01.715199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1b6c752d-d2a8-42d1-be11-3afaf2531335 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:01.721197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b6c752d-d2a8-42d1-be11-3afaf2531335 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:01.721668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b6c752d-d2a8-42d1-be11-3afaf2531335 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:01.722090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b6c752d-d2a8-42d1-be11-3afaf2531335 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:01.722781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b6c752d-d2a8-42d1-be11-3afaf2531335 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:01.723227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b6c752d-d2a8-42d1-be11-3afaf2531335 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:01.723657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1b6c752d-d2a8-42d1-be11-3afaf2531335 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:01.752517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1b6c752d-d2a8-42d1-be11-3afaf2531335 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 Aug 22 19:39:01.753060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 793/1444] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:02.765213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86758e6b-e3ae-4e49-b309-a120c2a5cb00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:02.767523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86758e6b-e3ae-4e49-b309-a120c2a5cb00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:02.774092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86758e6b-e3ae-4e49-b309-a120c2a5cb00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:02.774595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86758e6b-e3ae-4e49-b309-a120c2a5cb00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:02.775028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86758e6b-e3ae-4e49-b309-a120c2a5cb00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:02.775761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86758e6b-e3ae-4e49-b309-a120c2a5cb00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:02.776224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86758e6b-e3ae-4e49-b309-a120c2a5cb00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:02.776647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86758e6b-e3ae-4e49-b309-a120c2a5cb00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:02.805958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86758e6b-e3ae-4e49-b309-a120c2a5cb00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Aug 22 19:39:02.806500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 652/1445] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:03.818349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cf3b3408-04b8-4951-9312-6dbe2dedd3a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:03.820499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cf3b3408-04b8-4951-9312-6dbe2dedd3a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:03.826841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3b3408-04b8-4951-9312-6dbe2dedd3a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:03.827339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3b3408-04b8-4951-9312-6dbe2dedd3a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:03.827802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3b3408-04b8-4951-9312-6dbe2dedd3a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:03.828504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3b3408-04b8-4951-9312-6dbe2dedd3a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:03.828961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3b3408-04b8-4951-9312-6dbe2dedd3a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:03.829381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3b3408-04b8-4951-9312-6dbe2dedd3a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:03.858244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cf3b3408-04b8-4951-9312-6dbe2dedd3a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Aug 22 19:39:03.859405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 794/1446] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:04.870526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6104919b-dd5c-4538-ac6c-5c3e7b1bba64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:04.872728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6104919b-dd5c-4538-ac6c-5c3e7b1bba64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:04.879809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6104919b-dd5c-4538-ac6c-5c3e7b1bba64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:04.880288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6104919b-dd5c-4538-ac6c-5c3e7b1bba64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:04.880720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6104919b-dd5c-4538-ac6c-5c3e7b1bba64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:04.881403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6104919b-dd5c-4538-ac6c-5c3e7b1bba64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:04.881869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6104919b-dd5c-4538-ac6c-5c3e7b1bba64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:04.882271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6104919b-dd5c-4538-ac6c-5c3e7b1bba64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:04.910188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6104919b-dd5c-4538-ac6c-5c3e7b1bba64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043632 Aug 22 19:39:04.910724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 653/1447] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:05.922559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fade7f9f-dc75-4808-bf99-d0bb3358dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:05.924736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fade7f9f-dc75-4808-bf99-d0bb3358dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:05.931059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fade7f9f-dc75-4808-bf99-d0bb3358dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:05.931538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fade7f9f-dc75-4808-bf99-d0bb3358dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:05.932001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fade7f9f-dc75-4808-bf99-d0bb3358dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:05.932688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fade7f9f-dc75-4808-bf99-d0bb3358dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:05.933139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fade7f9f-dc75-4808-bf99-d0bb3358dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:05.933568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fade7f9f-dc75-4808-bf99-d0bb3358dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:05.963978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fade7f9f-dc75-4808-bf99-d0bb3358dcc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045386 Aug 22 19:39:05.964521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 795/1448] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:06.976581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41fb6860-1878-46b6-be40-e97259595823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:06.978734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41fb6860-1878-46b6-be40-e97259595823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:06.985148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fb6860-1878-46b6-be40-e97259595823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:06.985565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fb6860-1878-46b6-be40-e97259595823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:06.985995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fb6860-1878-46b6-be40-e97259595823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:06.986679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fb6860-1878-46b6-be40-e97259595823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:06.987125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fb6860-1878-46b6-be40-e97259595823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:06.987543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fb6860-1878-46b6-be40-e97259595823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:07.015162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41fb6860-1878-46b6-be40-e97259595823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042546 Aug 22 19:39:07.015712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 654/1449] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:08.027888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3850b1fa-8c23-4c58-927f-8492721f7b21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:08.029996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3850b1fa-8c23-4c58-927f-8492721f7b21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:08.036991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3850b1fa-8c23-4c58-927f-8492721f7b21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:08.037462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3850b1fa-8c23-4c58-927f-8492721f7b21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:08.037887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3850b1fa-8c23-4c58-927f-8492721f7b21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:08.038568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3850b1fa-8c23-4c58-927f-8492721f7b21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:08.039014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3850b1fa-8c23-4c58-927f-8492721f7b21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:08.039429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3850b1fa-8c23-4c58-927f-8492721f7b21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:08.068224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3850b1fa-8c23-4c58-927f-8492721f7b21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Aug 22 19:39:08.068837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 796/1450] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:09.081021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ea16d07-87f6-4abe-842e-4d4b2a55958e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:09.083167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ea16d07-87f6-4abe-842e-4d4b2a55958e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:09.089837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ea16d07-87f6-4abe-842e-4d4b2a55958e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:09.090316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ea16d07-87f6-4abe-842e-4d4b2a55958e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:09.090753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ea16d07-87f6-4abe-842e-4d4b2a55958e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:09.091446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ea16d07-87f6-4abe-842e-4d4b2a55958e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:09.091930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ea16d07-87f6-4abe-842e-4d4b2a55958e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:09.092354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ea16d07-87f6-4abe-842e-4d4b2a55958e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:09.121395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ea16d07-87f6-4abe-842e-4d4b2a55958e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Aug 22 19:39:09.121942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 655/1451] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:09 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:10.134239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a5eabf69-b3e6-425a-8ff7-8677889cc845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:10.136415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a5eabf69-b3e6-425a-8ff7-8677889cc845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:10.143314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5eabf69-b3e6-425a-8ff7-8677889cc845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:10.143831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5eabf69-b3e6-425a-8ff7-8677889cc845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:10.144261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5eabf69-b3e6-425a-8ff7-8677889cc845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:10.145076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5eabf69-b3e6-425a-8ff7-8677889cc845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:10.145593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5eabf69-b3e6-425a-8ff7-8677889cc845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:10.146019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5eabf69-b3e6-425a-8ff7-8677889cc845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:10.149812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=87 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:10.175368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a5eabf69-b3e6-425a-8ff7-8677889cc845 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Aug 22 19:39:10.175940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 797/1452] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:11.187107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83c94742-f41c-4e25-bef8-d1d093044373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:11.189269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83c94742-f41c-4e25-bef8-d1d093044373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:11.195708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83c94742-f41c-4e25-bef8-d1d093044373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:11.196191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83c94742-f41c-4e25-bef8-d1d093044373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:11.196628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83c94742-f41c-4e25-bef8-d1d093044373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:11.197319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83c94742-f41c-4e25-bef8-d1d093044373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:11.197775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83c94742-f41c-4e25-bef8-d1d093044373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:11.198199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83c94742-f41c-4e25-bef8-d1d093044373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:11.227127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83c94742-f41c-4e25-bef8-d1d093044373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Aug 22 19:39:11.227682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 656/1453] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:12.238999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6b62f1a9-5b9f-490c-9649-f3b9b0944202 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:12.241216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6b62f1a9-5b9f-490c-9649-f3b9b0944202 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:12.247577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b62f1a9-5b9f-490c-9649-f3b9b0944202 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:12.248215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b62f1a9-5b9f-490c-9649-f3b9b0944202 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:12.248645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b62f1a9-5b9f-490c-9649-f3b9b0944202 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:12.249336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b62f1a9-5b9f-490c-9649-f3b9b0944202 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:12.249786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b62f1a9-5b9f-490c-9649-f3b9b0944202 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:12.250209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b62f1a9-5b9f-490c-9649-f3b9b0944202 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:12.279058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6b62f1a9-5b9f-490c-9649-f3b9b0944202 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Aug 22 19:39:12.279608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 798/1454] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:13.290913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9232426-60e3-478c-9883-c4f3466b57e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:13.293077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9232426-60e3-478c-9883-c4f3466b57e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:13.300152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9232426-60e3-478c-9883-c4f3466b57e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:13.300625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9232426-60e3-478c-9883-c4f3466b57e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:13.301056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9232426-60e3-478c-9883-c4f3466b57e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:13.301747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9232426-60e3-478c-9883-c4f3466b57e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:13.302203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9232426-60e3-478c-9883-c4f3466b57e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:13.302626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9232426-60e3-478c-9883-c4f3466b57e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:13.304979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:13.332853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9232426-60e3-478c-9883-c4f3466b57e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Aug 22 19:39:13.333412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 657/1455] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:14.345283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9639c78b-4852-4144-a59c-f608ea6a3c74 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:14.347939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9639c78b-4852-4144-a59c-f608ea6a3c74 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:14.354258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9639c78b-4852-4144-a59c-f608ea6a3c74 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:14.354738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9639c78b-4852-4144-a59c-f608ea6a3c74 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:14.355170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9639c78b-4852-4144-a59c-f608ea6a3c74 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:14.355896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9639c78b-4852-4144-a59c-f608ea6a3c74 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:14.356369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9639c78b-4852-4144-a59c-f608ea6a3c74 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:14.356793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9639c78b-4852-4144-a59c-f608ea6a3c74 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:14.385292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9639c78b-4852-4144-a59c-f608ea6a3c74 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Aug 22 19:39:14.385847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 799/1456] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:15.398217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ff2279c-2d05-4eb8-91e5-8e991f949cdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:15.400329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ff2279c-2d05-4eb8-91e5-8e991f949cdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:15.407077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff2279c-2d05-4eb8-91e5-8e991f949cdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:15.407553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff2279c-2d05-4eb8-91e5-8e991f949cdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:15.408016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff2279c-2d05-4eb8-91e5-8e991f949cdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:15.409292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff2279c-2d05-4eb8-91e5-8e991f949cdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:15.409763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff2279c-2d05-4eb8-91e5-8e991f949cdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:15.410179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff2279c-2d05-4eb8-91e5-8e991f949cdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:15.438636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ff2279c-2d05-4eb8-91e5-8e991f949cdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Aug 22 19:39:15.439176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 658/1457] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:15 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:16.451049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-510c8544-869a-4585-9089-2ca7e4f205d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:16.453218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-510c8544-869a-4585-9089-2ca7e4f205d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:16.460497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510c8544-869a-4585-9089-2ca7e4f205d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:16.460970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510c8544-869a-4585-9089-2ca7e4f205d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:16.461399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510c8544-869a-4585-9089-2ca7e4f205d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:16.462074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510c8544-869a-4585-9089-2ca7e4f205d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:16.462518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510c8544-869a-4585-9089-2ca7e4f205d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:16.462933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-510c8544-869a-4585-9089-2ca7e4f205d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:16.491232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-510c8544-869a-4585-9089-2ca7e4f205d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Aug 22 19:39:16.491808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 800/1458] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:17.504550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ff025eb-957c-451f-9475-646b02a76de2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:17.506687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ff025eb-957c-451f-9475-646b02a76de2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:17.513113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff025eb-957c-451f-9475-646b02a76de2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:17.513592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff025eb-957c-451f-9475-646b02a76de2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:17.514029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff025eb-957c-451f-9475-646b02a76de2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:17.514719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff025eb-957c-451f-9475-646b02a76de2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:17.515171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff025eb-957c-451f-9475-646b02a76de2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:17.515593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ff025eb-957c-451f-9475-646b02a76de2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:17.543962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ff025eb-957c-451f-9475-646b02a76de2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Aug 22 19:39:17.544513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 659/1459] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:18.556241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b07b8b14-fe13-4a61-b805-6b79491b238d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:18.558350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b07b8b14-fe13-4a61-b805-6b79491b238d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:18.560627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=30 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:18.566238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b07b8b14-fe13-4a61-b805-6b79491b238d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:18.566710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b07b8b14-fe13-4a61-b805-6b79491b238d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:18.567135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b07b8b14-fe13-4a61-b805-6b79491b238d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:18.567854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b07b8b14-fe13-4a61-b805-6b79491b238d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:18.568296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b07b8b14-fe13-4a61-b805-6b79491b238d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:18.568711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b07b8b14-fe13-4a61-b805-6b79491b238d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:18.597750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b07b8b14-fe13-4a61-b805-6b79491b238d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045414 Aug 22 19:39:18.598295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 801/1460] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:19.610149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7364709e-0bc1-49cd-86a4-32d72fa98906 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:19.612335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7364709e-0bc1-49cd-86a4-32d72fa98906 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:19.615183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:19.620519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7364709e-0bc1-49cd-86a4-32d72fa98906 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:19.621006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7364709e-0bc1-49cd-86a4-32d72fa98906 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:19.621445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7364709e-0bc1-49cd-86a4-32d72fa98906 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:19.622147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7364709e-0bc1-49cd-86a4-32d72fa98906 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:19.622602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7364709e-0bc1-49cd-86a4-32d72fa98906 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:19.623029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7364709e-0bc1-49cd-86a4-32d72fa98906 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:19.652046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7364709e-0bc1-49cd-86a4-32d72fa98906 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Aug 22 19:39:19.652592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 660/1461] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:20.665594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4573226c-2e53-45be-a6f8-803693178c86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:20.667755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4573226c-2e53-45be-a6f8-803693178c86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:20.674252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4573226c-2e53-45be-a6f8-803693178c86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:20.674726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4573226c-2e53-45be-a6f8-803693178c86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:20.675189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4573226c-2e53-45be-a6f8-803693178c86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:20.675909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4573226c-2e53-45be-a6f8-803693178c86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:20.676354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4573226c-2e53-45be-a6f8-803693178c86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:20.676771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4573226c-2e53-45be-a6f8-803693178c86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:20.705218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4573226c-2e53-45be-a6f8-803693178c86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Aug 22 19:39:20.705756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 802/1462] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:39:21.718408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e855aa6f-c98a-4ae8-b01a-6c30056f161a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:21.720584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e855aa6f-c98a-4ae8-b01a-6c30056f161a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:21.727147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e855aa6f-c98a-4ae8-b01a-6c30056f161a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:21.727669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e855aa6f-c98a-4ae8-b01a-6c30056f161a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:21.728095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e855aa6f-c98a-4ae8-b01a-6c30056f161a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:21.728792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e855aa6f-c98a-4ae8-b01a-6c30056f161a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:21.729247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e855aa6f-c98a-4ae8-b01a-6c30056f161a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:21.729672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e855aa6f-c98a-4ae8-b01a-6c30056f161a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:21.758228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e855aa6f-c98a-4ae8-b01a-6c30056f161a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Aug 22 19:39:21.758774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 661/1463] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:22.769852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-42c5aa3d-fcf3-4c22-bc2e-e3da45df1be6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:22.771971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-42c5aa3d-fcf3-4c22-bc2e-e3da45df1be6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:22.778309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42c5aa3d-fcf3-4c22-bc2e-e3da45df1be6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:22.778786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42c5aa3d-fcf3-4c22-bc2e-e3da45df1be6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:22.779213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42c5aa3d-fcf3-4c22-bc2e-e3da45df1be6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:22.779923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42c5aa3d-fcf3-4c22-bc2e-e3da45df1be6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:22.780368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42c5aa3d-fcf3-4c22-bc2e-e3da45df1be6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:22.780785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42c5aa3d-fcf3-4c22-bc2e-e3da45df1be6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:22.809618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-42c5aa3d-fcf3-4c22-bc2e-e3da45df1be6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Aug 22 19:39:22.810164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 803/1464] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:23.822672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-502b4f92-42e6-4554-8d2f-f1cf24c3e5ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:23.825057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-502b4f92-42e6-4554-8d2f-f1cf24c3e5ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:23.832084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502b4f92-42e6-4554-8d2f-f1cf24c3e5ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:23.832562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502b4f92-42e6-4554-8d2f-f1cf24c3e5ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:23.832997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502b4f92-42e6-4554-8d2f-f1cf24c3e5ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:23.833689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502b4f92-42e6-4554-8d2f-f1cf24c3e5ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:23.834419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502b4f92-42e6-4554-8d2f-f1cf24c3e5ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:23.834828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502b4f92-42e6-4554-8d2f-f1cf24c3e5ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:23.863063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-502b4f92-42e6-4554-8d2f-f1cf24c3e5ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Aug 22 19:39:23.863528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 662/1465] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:24.875197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6775a6cd-92c2-476c-9c45-9410ac9bc248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:24.877404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6775a6cd-92c2-476c-9c45-9410ac9bc248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:24.884377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6775a6cd-92c2-476c-9c45-9410ac9bc248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:24.884847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6775a6cd-92c2-476c-9c45-9410ac9bc248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:24.885278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6775a6cd-92c2-476c-9c45-9410ac9bc248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:24.885961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6775a6cd-92c2-476c-9c45-9410ac9bc248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:24.886431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6775a6cd-92c2-476c-9c45-9410ac9bc248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:24.886848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6775a6cd-92c2-476c-9c45-9410ac9bc248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:24.915278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6775a6cd-92c2-476c-9c45-9410ac9bc248 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Aug 22 19:39:24.915278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 804/1466] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:25.927392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6fde2774-585c-433c-8330-508a13e5f9a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:25.929553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6fde2774-585c-433c-8330-508a13e5f9a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:25.936198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fde2774-585c-433c-8330-508a13e5f9a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:25.936668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fde2774-585c-433c-8330-508a13e5f9a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:25.937096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fde2774-585c-433c-8330-508a13e5f9a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:25.937778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fde2774-585c-433c-8330-508a13e5f9a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:25.938222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fde2774-585c-433c-8330-508a13e5f9a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:25.938636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6fde2774-585c-433c-8330-508a13e5f9a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:25.968680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6fde2774-585c-433c-8330-508a13e5f9a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045867 Aug 22 19:39:25.969226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 663/1467] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:26.980828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ca7f5027-ad10-49b6-93be-060cbb2a87b0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:26.982940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ca7f5027-ad10-49b6-93be-060cbb2a87b0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:26.991684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca7f5027-ad10-49b6-93be-060cbb2a87b0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:26.992163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca7f5027-ad10-49b6-93be-060cbb2a87b0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:26.992588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca7f5027-ad10-49b6-93be-060cbb2a87b0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:26.993279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca7f5027-ad10-49b6-93be-060cbb2a87b0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:26.993724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca7f5027-ad10-49b6-93be-060cbb2a87b0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:26.994142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ca7f5027-ad10-49b6-93be-060cbb2a87b0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:27.023041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ca7f5027-ad10-49b6-93be-060cbb2a87b0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Aug 22 19:39:27.023595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 805/1468] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:28.035607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ea0e4c2-f294-41cf-95a4-fac10690d459 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:28.037783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ea0e4c2-f294-41cf-95a4-fac10690d459 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:28.043735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ea0e4c2-f294-41cf-95a4-fac10690d459 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:28.044210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ea0e4c2-f294-41cf-95a4-fac10690d459 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:28.044749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ea0e4c2-f294-41cf-95a4-fac10690d459 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:28.045434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ea0e4c2-f294-41cf-95a4-fac10690d459 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:28.045880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ea0e4c2-f294-41cf-95a4-fac10690d459 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:28.046298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ea0e4c2-f294-41cf-95a4-fac10690d459 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:28.075796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ea0e4c2-f294-41cf-95a4-fac10690d459 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Aug 22 19:39:28.076339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 664/1469] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:29.087784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a9c6daf7-0f77-4a0e-8cc7-424daffe8128 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:29.090548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a9c6daf7-0f77-4a0e-8cc7-424daffe8128 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:29.096909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c6daf7-0f77-4a0e-8cc7-424daffe8128 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:29.097382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c6daf7-0f77-4a0e-8cc7-424daffe8128 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:29.097813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c6daf7-0f77-4a0e-8cc7-424daffe8128 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:29.098521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c6daf7-0f77-4a0e-8cc7-424daffe8128 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:29.099055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c6daf7-0f77-4a0e-8cc7-424daffe8128 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:29.099593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c6daf7-0f77-4a0e-8cc7-424daffe8128 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:29.128958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a9c6daf7-0f77-4a0e-8cc7-424daffe8128 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Aug 22 19:39:29.129510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 806/1470] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:29 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:30.141745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-617f47d0-63fd-44d9-b9b9-1d79a89f16f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:30.143917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-617f47d0-63fd-44d9-b9b9-1d79a89f16f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:30.150884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617f47d0-63fd-44d9-b9b9-1d79a89f16f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:30.151369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617f47d0-63fd-44d9-b9b9-1d79a89f16f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:30.151840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617f47d0-63fd-44d9-b9b9-1d79a89f16f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:30.152544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617f47d0-63fd-44d9-b9b9-1d79a89f16f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:30.152996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617f47d0-63fd-44d9-b9b9-1d79a89f16f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:30.153417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617f47d0-63fd-44d9-b9b9-1d79a89f16f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:30.182021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-617f47d0-63fd-44d9-b9b9-1d79a89f16f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Aug 22 19:39:30.182593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 665/1471] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:31.194754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8585142f-4aed-4733-a9bc-9258b0ba7510 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:31.196914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8585142f-4aed-4733-a9bc-9258b0ba7510 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:31.203328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8585142f-4aed-4733-a9bc-9258b0ba7510 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:31.203844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8585142f-4aed-4733-a9bc-9258b0ba7510 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:31.204524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8585142f-4aed-4733-a9bc-9258b0ba7510 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:31.205375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8585142f-4aed-4733-a9bc-9258b0ba7510 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:31.205825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8585142f-4aed-4733-a9bc-9258b0ba7510 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:31.206244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8585142f-4aed-4733-a9bc-9258b0ba7510 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:31.235572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8585142f-4aed-4733-a9bc-9258b0ba7510 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Aug 22 19:39:31.236152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 807/1472] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:39:32.248015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe75d61b-36af-4212-a17b-a79bcb388136 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:32.250147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe75d61b-36af-4212-a17b-a79bcb388136 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:32.256503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe75d61b-36af-4212-a17b-a79bcb388136 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:32.256961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe75d61b-36af-4212-a17b-a79bcb388136 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:32.257392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe75d61b-36af-4212-a17b-a79bcb388136 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:32.258081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe75d61b-36af-4212-a17b-a79bcb388136 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:32.258530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe75d61b-36af-4212-a17b-a79bcb388136 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:32.258951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe75d61b-36af-4212-a17b-a79bcb388136 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:32.287496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe75d61b-36af-4212-a17b-a79bcb388136 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Aug 22 19:39:32.288067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 666/1473] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:33.299435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-71dbe58e-4f8c-4572-a32f-8305ee015aaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:33.301583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-71dbe58e-4f8c-4572-a32f-8305ee015aaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:33.307841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71dbe58e-4f8c-4572-a32f-8305ee015aaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:33.308312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71dbe58e-4f8c-4572-a32f-8305ee015aaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:33.308739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71dbe58e-4f8c-4572-a32f-8305ee015aaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:33.309426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71dbe58e-4f8c-4572-a32f-8305ee015aaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:33.309874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71dbe58e-4f8c-4572-a32f-8305ee015aaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:33.310296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-71dbe58e-4f8c-4572-a32f-8305ee015aaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:33.339753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-71dbe58e-4f8c-4572-a32f-8305ee015aaf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Aug 22 19:39:33.340316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 808/1474] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:34.353919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f779dc39-5d4a-4818-a2f1-54043a23306c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:34.356440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f779dc39-5d4a-4818-a2f1-54043a23306c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:34.363097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f779dc39-5d4a-4818-a2f1-54043a23306c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:34.363577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f779dc39-5d4a-4818-a2f1-54043a23306c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:34.364048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f779dc39-5d4a-4818-a2f1-54043a23306c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:34.364743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f779dc39-5d4a-4818-a2f1-54043a23306c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:34.365192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f779dc39-5d4a-4818-a2f1-54043a23306c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:34.365614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f779dc39-5d4a-4818-a2f1-54043a23306c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:34.395442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f779dc39-5d4a-4818-a2f1-54043a23306c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045846 Aug 22 19:39:34.396742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 667/1475] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:34 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:35.408210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d212928d-56f7-4644-b164-edd40b698e1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:35.410356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d212928d-56f7-4644-b164-edd40b698e1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:35.417493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d212928d-56f7-4644-b164-edd40b698e1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:35.417969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d212928d-56f7-4644-b164-edd40b698e1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:35.418397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d212928d-56f7-4644-b164-edd40b698e1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:35.419080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d212928d-56f7-4644-b164-edd40b698e1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:35.419527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d212928d-56f7-4644-b164-edd40b698e1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:35.419968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d212928d-56f7-4644-b164-edd40b698e1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:35.447784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d212928d-56f7-4644-b164-edd40b698e1e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Aug 22 19:39:35.448329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 809/1476] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:36.460425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6167da56-d07a-40c6-a79c-7267b382da1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:36.462709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6167da56-d07a-40c6-a79c-7267b382da1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:36.469269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167da56-d07a-40c6-a79c-7267b382da1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:36.469739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167da56-d07a-40c6-a79c-7267b382da1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:36.470164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167da56-d07a-40c6-a79c-7267b382da1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:36.470878 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167da56-d07a-40c6-a79c-7267b382da1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:36.471325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167da56-d07a-40c6-a79c-7267b382da1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:36.471770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6167da56-d07a-40c6-a79c-7267b382da1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:36.502348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6167da56-d07a-40c6-a79c-7267b382da1d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046084 Aug 22 19:39:36.502823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 668/1477] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:39:37.514580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-245a61ac-7c35-4db8-8974-0ab326995b96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:37.516775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-245a61ac-7c35-4db8-8974-0ab326995b96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:37.523728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-245a61ac-7c35-4db8-8974-0ab326995b96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:37.524217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-245a61ac-7c35-4db8-8974-0ab326995b96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:37.524650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-245a61ac-7c35-4db8-8974-0ab326995b96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:37.525339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-245a61ac-7c35-4db8-8974-0ab326995b96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:37.525790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-245a61ac-7c35-4db8-8974-0ab326995b96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:37.526211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-245a61ac-7c35-4db8-8974-0ab326995b96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:37.554483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-245a61ac-7c35-4db8-8974-0ab326995b96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Aug 22 19:39:37.555035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 810/1478] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:38.566693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7b9e7eb-2324-4b25-bd21-387beecef01c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:38.568857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a7b9e7eb-2324-4b25-bd21-387beecef01c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:38.575477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b9e7eb-2324-4b25-bd21-387beecef01c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:38.575991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b9e7eb-2324-4b25-bd21-387beecef01c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:38.576431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b9e7eb-2324-4b25-bd21-387beecef01c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:38.577126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b9e7eb-2324-4b25-bd21-387beecef01c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:38.577580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b9e7eb-2324-4b25-bd21-387beecef01c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:38.578004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7b9e7eb-2324-4b25-bd21-387beecef01c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:38.607847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7b9e7eb-2324-4b25-bd21-387beecef01c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045092 Aug 22 19:39:38.608395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 669/1479] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:39.620418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0b972971-14ff-409f-a88b-7bb7a0814ce1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:39.622536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0b972971-14ff-409f-a88b-7bb7a0814ce1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:39.629277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b972971-14ff-409f-a88b-7bb7a0814ce1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:39.629753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b972971-14ff-409f-a88b-7bb7a0814ce1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:39.630182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b972971-14ff-409f-a88b-7bb7a0814ce1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:39.630866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b972971-14ff-409f-a88b-7bb7a0814ce1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:39.631313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b972971-14ff-409f-a88b-7bb7a0814ce1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:39.631767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b972971-14ff-409f-a88b-7bb7a0814ce1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:39.659453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0b972971-14ff-409f-a88b-7bb7a0814ce1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042947 Aug 22 19:39:39.660025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 811/1480] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:40.672171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cad277b1-f2ca-47a9-b6ef-100f3c88ba15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:40.674215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cad277b1-f2ca-47a9-b6ef-100f3c88ba15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:40.681072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad277b1-f2ca-47a9-b6ef-100f3c88ba15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:40.681612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad277b1-f2ca-47a9-b6ef-100f3c88ba15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:40.681973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad277b1-f2ca-47a9-b6ef-100f3c88ba15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:40.682654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad277b1-f2ca-47a9-b6ef-100f3c88ba15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:40.683100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad277b1-f2ca-47a9-b6ef-100f3c88ba15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:40.683519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad277b1-f2ca-47a9-b6ef-100f3c88ba15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:40.713006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cad277b1-f2ca-47a9-b6ef-100f3c88ba15 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Aug 22 19:39:40.713548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 670/1481] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:41.724517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-35ccf0b1-882f-4547-9c64-57419fbdd71d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:41.728557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-35ccf0b1-882f-4547-9c64-57419fbdd71d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:41.734442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ccf0b1-882f-4547-9c64-57419fbdd71d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:41.734919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ccf0b1-882f-4547-9c64-57419fbdd71d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:41.735347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ccf0b1-882f-4547-9c64-57419fbdd71d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:41.736067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ccf0b1-882f-4547-9c64-57419fbdd71d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:41.736510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ccf0b1-882f-4547-9c64-57419fbdd71d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:41.736924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ccf0b1-882f-4547-9c64-57419fbdd71d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:41.740482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=90 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:41.766493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-35ccf0b1-882f-4547-9c64-57419fbdd71d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Aug 22 19:39:41.767035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 812/1482] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:42.777708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-279c728d-dda2-41d5-a582-748f5248778e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:42.779889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-279c728d-dda2-41d5-a582-748f5248778e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:42.786202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-279c728d-dda2-41d5-a582-748f5248778e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:42.786688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-279c728d-dda2-41d5-a582-748f5248778e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:42.787125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-279c728d-dda2-41d5-a582-748f5248778e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:42.787861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-279c728d-dda2-41d5-a582-748f5248778e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:42.788315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-279c728d-dda2-41d5-a582-748f5248778e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:42.788742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-279c728d-dda2-41d5-a582-748f5248778e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:42.817388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-279c728d-dda2-41d5-a582-748f5248778e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Aug 22 19:39:42.817926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 671/1483] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:43.830482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-567c5db8-a892-4777-a4d0-af486fbc1458 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:43.832651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-567c5db8-a892-4777-a4d0-af486fbc1458 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:43.839813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-567c5db8-a892-4777-a4d0-af486fbc1458 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:43.840298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-567c5db8-a892-4777-a4d0-af486fbc1458 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:43.840737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-567c5db8-a892-4777-a4d0-af486fbc1458 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:43.841437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-567c5db8-a892-4777-a4d0-af486fbc1458 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:43.841893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-567c5db8-a892-4777-a4d0-af486fbc1458 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:43.842319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-567c5db8-a892-4777-a4d0-af486fbc1458 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:43.871988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-567c5db8-a892-4777-a4d0-af486fbc1458 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Aug 22 19:39:43.872473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 813/1484] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:43 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:44.884104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0902b5f3-8a2f-45a7-8305-822f7cdd82b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:44.886273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0902b5f3-8a2f-45a7-8305-822f7cdd82b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:44.892678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0902b5f3-8a2f-45a7-8305-822f7cdd82b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:44.893157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0902b5f3-8a2f-45a7-8305-822f7cdd82b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:44.893589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0902b5f3-8a2f-45a7-8305-822f7cdd82b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:44.894280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0902b5f3-8a2f-45a7-8305-822f7cdd82b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:44.894734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0902b5f3-8a2f-45a7-8305-822f7cdd82b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:44.895159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0902b5f3-8a2f-45a7-8305-822f7cdd82b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:44.897501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:44.924402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0902b5f3-8a2f-45a7-8305-822f7cdd82b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Aug 22 19:39:44.924939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 672/1485] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:45.937295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-44e91a64-11bb-4cd2-8554-3b9a472a4b60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:45.939404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-44e91a64-11bb-4cd2-8554-3b9a472a4b60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:45.946625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-44e91a64-11bb-4cd2-8554-3b9a472a4b60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:45.947097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-44e91a64-11bb-4cd2-8554-3b9a472a4b60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:45.947524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-44e91a64-11bb-4cd2-8554-3b9a472a4b60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:45.948228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-44e91a64-11bb-4cd2-8554-3b9a472a4b60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:45.948670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-44e91a64-11bb-4cd2-8554-3b9a472a4b60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:45.949086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-44e91a64-11bb-4cd2-8554-3b9a472a4b60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:45.977857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-44e91a64-11bb-4cd2-8554-3b9a472a4b60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Aug 22 19:39:45.978395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 814/1486] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:46.989357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7194cc72-07d6-4f54-914b-8c59aa37bcdf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:46.991540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7194cc72-07d6-4f54-914b-8c59aa37bcdf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:46.998030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7194cc72-07d6-4f54-914b-8c59aa37bcdf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:46.998502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7194cc72-07d6-4f54-914b-8c59aa37bcdf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:46.998936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7194cc72-07d6-4f54-914b-8c59aa37bcdf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:46.999627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7194cc72-07d6-4f54-914b-8c59aa37bcdf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:47.000103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7194cc72-07d6-4f54-914b-8c59aa37bcdf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:47.000527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7194cc72-07d6-4f54-914b-8c59aa37bcdf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:47.029090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7194cc72-07d6-4f54-914b-8c59aa37bcdf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Aug 22 19:39:47.029639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 673/1487] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:48.042497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-de1f5a0c-5ff5-4700-80c5-63f6192f79ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:48.044808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-de1f5a0c-5ff5-4700-80c5-63f6192f79ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:48.051839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de1f5a0c-5ff5-4700-80c5-63f6192f79ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:48.052362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de1f5a0c-5ff5-4700-80c5-63f6192f79ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:48.052793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de1f5a0c-5ff5-4700-80c5-63f6192f79ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:48.054108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de1f5a0c-5ff5-4700-80c5-63f6192f79ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:48.054569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de1f5a0c-5ff5-4700-80c5-63f6192f79ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:48.054991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de1f5a0c-5ff5-4700-80c5-63f6192f79ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:48.083142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-de1f5a0c-5ff5-4700-80c5-63f6192f79ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045804 Aug 22 19:39:48.083957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 815/1488] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:49.096521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f7e88d5-fd11-4f3a-a6bc-9137a57732f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:49.098647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8f7e88d5-fd11-4f3a-a6bc-9137a57732f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:49.105581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7e88d5-fd11-4f3a-a6bc-9137a57732f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:49.106064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7e88d5-fd11-4f3a-a6bc-9137a57732f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:49.106508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7e88d5-fd11-4f3a-a6bc-9137a57732f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:49.107385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7e88d5-fd11-4f3a-a6bc-9137a57732f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:49.108057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7e88d5-fd11-4f3a-a6bc-9137a57732f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:49.108490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f7e88d5-fd11-4f3a-a6bc-9137a57732f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:49.137316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f7e88d5-fd11-4f3a-a6bc-9137a57732f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Aug 22 19:39:49.137862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 674/1489] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:50.149492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d7926aa4-6e5e-4229-9916-a9a8f9f14dbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:50.151626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d7926aa4-6e5e-4229-9916-a9a8f9f14dbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:50.153911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=30 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:50.158924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7926aa4-6e5e-4229-9916-a9a8f9f14dbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:50.159400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7926aa4-6e5e-4229-9916-a9a8f9f14dbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:50.159857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7926aa4-6e5e-4229-9916-a9a8f9f14dbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:50.160545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7926aa4-6e5e-4229-9916-a9a8f9f14dbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:50.160990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7926aa4-6e5e-4229-9916-a9a8f9f14dbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:50.161409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7926aa4-6e5e-4229-9916-a9a8f9f14dbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:50.192014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d7926aa4-6e5e-4229-9916-a9a8f9f14dbe tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046311 Aug 22 19:39:50.192561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 816/1490] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:51.203986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3c10411-d25c-4987-9142-e9c4d06b6f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:51.206114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3c10411-d25c-4987-9142-e9c4d06b6f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:51.208782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:51.214408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3c10411-d25c-4987-9142-e9c4d06b6f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:51.214889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3c10411-d25c-4987-9142-e9c4d06b6f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:51.215323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3c10411-d25c-4987-9142-e9c4d06b6f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:51.216042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3c10411-d25c-4987-9142-e9c4d06b6f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:51.216604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3c10411-d25c-4987-9142-e9c4d06b6f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:51.216915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3c10411-d25c-4987-9142-e9c4d06b6f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:51.250429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3c10411-d25c-4987-9142-e9c4d06b6f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050451 Aug 22 19:39:51.250990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 675/1491] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:52.263019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0dd888f7-2646-416d-a2ca-d2c1105681b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:52.265230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0dd888f7-2646-416d-a2ca-d2c1105681b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:52.271621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dd888f7-2646-416d-a2ca-d2c1105681b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:52.272129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dd888f7-2646-416d-a2ca-d2c1105681b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:52.272558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dd888f7-2646-416d-a2ca-d2c1105681b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:52.273243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dd888f7-2646-416d-a2ca-d2c1105681b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:52.273695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dd888f7-2646-416d-a2ca-d2c1105681b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:52.274120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dd888f7-2646-416d-a2ca-d2c1105681b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:52.302740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0dd888f7-2646-416d-a2ca-d2c1105681b2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Aug 22 19:39:52.303289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 817/1492] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:53.315508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b4e8097d-887f-4d8e-8b61-3975aefab0bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:53.317645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b4e8097d-887f-4d8e-8b61-3975aefab0bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:53.324767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e8097d-887f-4d8e-8b61-3975aefab0bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:53.325249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e8097d-887f-4d8e-8b61-3975aefab0bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:53.325676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e8097d-887f-4d8e-8b61-3975aefab0bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:53.326367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e8097d-887f-4d8e-8b61-3975aefab0bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:53.326810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e8097d-887f-4d8e-8b61-3975aefab0bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:53.327228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b4e8097d-887f-4d8e-8b61-3975aefab0bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:53.364600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b4e8097d-887f-4d8e-8b61-3975aefab0bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052939 Aug 22 19:39:53.365164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 676/1493] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:54.377382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2a6434cb-4db0-4911-97f6-6b682ad9ea1f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:54.379487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2a6434cb-4db0-4911-97f6-6b682ad9ea1f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:54.385957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a6434cb-4db0-4911-97f6-6b682ad9ea1f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:54.386441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a6434cb-4db0-4911-97f6-6b682ad9ea1f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:54.386878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a6434cb-4db0-4911-97f6-6b682ad9ea1f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:54.387571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a6434cb-4db0-4911-97f6-6b682ad9ea1f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:54.388081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a6434cb-4db0-4911-97f6-6b682ad9ea1f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:54.388507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a6434cb-4db0-4911-97f6-6b682ad9ea1f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:54.419346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2a6434cb-4db0-4911-97f6-6b682ad9ea1f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045938 Aug 22 19:39:54.419945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 818/1494] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:55.432182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ac31f8e-d7b1-48d6-97d9-7cf5735c5370 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:55.434347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ac31f8e-d7b1-48d6-97d9-7cf5735c5370 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:55.440819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac31f8e-d7b1-48d6-97d9-7cf5735c5370 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:55.441302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac31f8e-d7b1-48d6-97d9-7cf5735c5370 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:55.441736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac31f8e-d7b1-48d6-97d9-7cf5735c5370 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:55.442440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac31f8e-d7b1-48d6-97d9-7cf5735c5370 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:55.442892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac31f8e-d7b1-48d6-97d9-7cf5735c5370 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:55.443317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ac31f8e-d7b1-48d6-97d9-7cf5735c5370 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:55.471814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ac31f8e-d7b1-48d6-97d9-7cf5735c5370 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Aug 22 19:39:55.472358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 677/1495] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:56.484189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b433ebaf-a11f-44ae-874b-66e96afcc755 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:56.486287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b433ebaf-a11f-44ae-874b-66e96afcc755 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:56.492624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b433ebaf-a11f-44ae-874b-66e96afcc755 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:56.493098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b433ebaf-a11f-44ae-874b-66e96afcc755 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:56.493525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b433ebaf-a11f-44ae-874b-66e96afcc755 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:56.494206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b433ebaf-a11f-44ae-874b-66e96afcc755 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:56.494652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b433ebaf-a11f-44ae-874b-66e96afcc755 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:56.495071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b433ebaf-a11f-44ae-874b-66e96afcc755 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:56.524301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b433ebaf-a11f-44ae-874b-66e96afcc755 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Aug 22 19:39:56.524851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 819/1496] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:57.536802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-715afb7f-f67c-4a2c-b3c3-aebbb16ea4fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:57.538932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-715afb7f-f67c-4a2c-b3c3-aebbb16ea4fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:57.545443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-715afb7f-f67c-4a2c-b3c3-aebbb16ea4fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:57.545920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-715afb7f-f67c-4a2c-b3c3-aebbb16ea4fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:57.546353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-715afb7f-f67c-4a2c-b3c3-aebbb16ea4fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:57.547041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-715afb7f-f67c-4a2c-b3c3-aebbb16ea4fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:57.547493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-715afb7f-f67c-4a2c-b3c3-aebbb16ea4fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:57.547951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-715afb7f-f67c-4a2c-b3c3-aebbb16ea4fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:57.576526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-715afb7f-f67c-4a2c-b3c3-aebbb16ea4fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Aug 22 19:39:57.577062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 678/1497] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:58.589189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-066b7562-7c0e-4d03-8b03-12cb50057c6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:58.591323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-066b7562-7c0e-4d03-8b03-12cb50057c6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:58.597700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-066b7562-7c0e-4d03-8b03-12cb50057c6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:58.598180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-066b7562-7c0e-4d03-8b03-12cb50057c6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:58.598612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-066b7562-7c0e-4d03-8b03-12cb50057c6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:58.599307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-066b7562-7c0e-4d03-8b03-12cb50057c6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:58.599784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-066b7562-7c0e-4d03-8b03-12cb50057c6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:58.600221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-066b7562-7c0e-4d03-8b03-12cb50057c6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:58.629007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-066b7562-7c0e-4d03-8b03-12cb50057c6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Aug 22 19:39:58.629568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 820/1498] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:39:59.641940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-54cc3426-259a-4534-adeb-024d337f2c1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:39:59.644109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-54cc3426-259a-4534-adeb-024d337f2c1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:39:59.650022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54cc3426-259a-4534-adeb-024d337f2c1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:59.650502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54cc3426-259a-4534-adeb-024d337f2c1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:59.651029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54cc3426-259a-4534-adeb-024d337f2c1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:59.651748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54cc3426-259a-4534-adeb-024d337f2c1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:39:59.652205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54cc3426-259a-4534-adeb-024d337f2c1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:39:59.652631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54cc3426-259a-4534-adeb-024d337f2c1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:39:59.681837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-54cc3426-259a-4534-adeb-024d337f2c1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 Aug 22 19:39:59.682374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 679/1499] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:39:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:00.694017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ac7291b1-b0ba-4e08-9dca-736650962b20 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:00.696698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ac7291b1-b0ba-4e08-9dca-736650962b20 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:00.703354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac7291b1-b0ba-4e08-9dca-736650962b20 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:00.703948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac7291b1-b0ba-4e08-9dca-736650962b20 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:00.704381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac7291b1-b0ba-4e08-9dca-736650962b20 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:00.705071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac7291b1-b0ba-4e08-9dca-736650962b20 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:00.705515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac7291b1-b0ba-4e08-9dca-736650962b20 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:00.705935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac7291b1-b0ba-4e08-9dca-736650962b20 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:00.735235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ac7291b1-b0ba-4e08-9dca-736650962b20 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Aug 22 19:40:00.735807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 821/1500] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:01.747305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27d59d4a-23ee-413c-b1d7-1c25f63ea846 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:01.749511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-27d59d4a-23ee-413c-b1d7-1c25f63ea846 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:01.755823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27d59d4a-23ee-413c-b1d7-1c25f63ea846 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:01.756314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27d59d4a-23ee-413c-b1d7-1c25f63ea846 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:01.756728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27d59d4a-23ee-413c-b1d7-1c25f63ea846 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:01.757415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27d59d4a-23ee-413c-b1d7-1c25f63ea846 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:01.757886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27d59d4a-23ee-413c-b1d7-1c25f63ea846 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:01.758302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27d59d4a-23ee-413c-b1d7-1c25f63ea846 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:01.786674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-27d59d4a-23ee-413c-b1d7-1c25f63ea846 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043925 Aug 22 19:40:01.787209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 680/1501] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:40:02.799667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5556ce47-8cc7-4e49-ac1a-c355b47f07d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:02.802189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5556ce47-8cc7-4e49-ac1a-c355b47f07d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:02.808127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5556ce47-8cc7-4e49-ac1a-c355b47f07d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:02.808601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5556ce47-8cc7-4e49-ac1a-c355b47f07d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:02.809028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5556ce47-8cc7-4e49-ac1a-c355b47f07d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:02.809707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5556ce47-8cc7-4e49-ac1a-c355b47f07d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:02.810151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5556ce47-8cc7-4e49-ac1a-c355b47f07d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:02.810568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5556ce47-8cc7-4e49-ac1a-c355b47f07d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:02.841323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5556ce47-8cc7-4e49-ac1a-c355b47f07d3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Aug 22 19:40:02.841873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 822/1502] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:03.854261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd078e2b-bb65-4af3-89b1-669fe18485eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:03.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bd078e2b-bb65-4af3-89b1-669fe18485eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:03.862719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd078e2b-bb65-4af3-89b1-669fe18485eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:03.863197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd078e2b-bb65-4af3-89b1-669fe18485eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:03.863629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd078e2b-bb65-4af3-89b1-669fe18485eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:03.864343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd078e2b-bb65-4af3-89b1-669fe18485eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:03.864790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd078e2b-bb65-4af3-89b1-669fe18485eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:03.865210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd078e2b-bb65-4af3-89b1-669fe18485eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:03.893002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd078e2b-bb65-4af3-89b1-669fe18485eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Aug 22 19:40:03.893537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 681/1503] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:04.905257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dd8ff496-f0b5-4b9a-adae-605d0f0b1928 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:04.907535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dd8ff496-f0b5-4b9a-adae-605d0f0b1928 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:04.914425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8ff496-f0b5-4b9a-adae-605d0f0b1928 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:04.914899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8ff496-f0b5-4b9a-adae-605d0f0b1928 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:04.915326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8ff496-f0b5-4b9a-adae-605d0f0b1928 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:04.916077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8ff496-f0b5-4b9a-adae-605d0f0b1928 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:04.916523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8ff496-f0b5-4b9a-adae-605d0f0b1928 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:04.916939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8ff496-f0b5-4b9a-adae-605d0f0b1928 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:04.947279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dd8ff496-f0b5-4b9a-adae-605d0f0b1928 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Aug 22 19:40:04.947850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 823/1504] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:05.959686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebfcaed2-0a42-4b7d-bb70-75a02ef3eba0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:05.961847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ebfcaed2-0a42-4b7d-bb70-75a02ef3eba0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:05.968162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebfcaed2-0a42-4b7d-bb70-75a02ef3eba0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:05.968637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebfcaed2-0a42-4b7d-bb70-75a02ef3eba0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:05.969068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebfcaed2-0a42-4b7d-bb70-75a02ef3eba0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:05.969752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebfcaed2-0a42-4b7d-bb70-75a02ef3eba0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:05.970198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebfcaed2-0a42-4b7d-bb70-75a02ef3eba0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:05.970618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebfcaed2-0a42-4b7d-bb70-75a02ef3eba0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:06.000346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ebfcaed2-0a42-4b7d-bb70-75a02ef3eba0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Aug 22 19:40:06.000899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 682/1505] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:07.013188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4dee9d89-f7cf-4a1f-b406-c981e784ef8e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:07.015334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4dee9d89-f7cf-4a1f-b406-c981e784ef8e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:07.021629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dee9d89-f7cf-4a1f-b406-c981e784ef8e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:07.022099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dee9d89-f7cf-4a1f-b406-c981e784ef8e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:07.022523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dee9d89-f7cf-4a1f-b406-c981e784ef8e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:07.023235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dee9d89-f7cf-4a1f-b406-c981e784ef8e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:07.023715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dee9d89-f7cf-4a1f-b406-c981e784ef8e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:07.024138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dee9d89-f7cf-4a1f-b406-c981e784ef8e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:07.052901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4dee9d89-f7cf-4a1f-b406-c981e784ef8e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043656 Aug 22 19:40:07.053683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 824/1506] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:40:07.239123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:40:07.239355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:40:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:40:08.065115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3a07cec-3f4b-419f-a2cb-f8983f3eb47e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:08.067249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3a07cec-3f4b-419f-a2cb-f8983f3eb47e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:08.074178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a07cec-3f4b-419f-a2cb-f8983f3eb47e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:08.074653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a07cec-3f4b-419f-a2cb-f8983f3eb47e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:08.075080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a07cec-3f4b-419f-a2cb-f8983f3eb47e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:08.075792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a07cec-3f4b-419f-a2cb-f8983f3eb47e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:08.076239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a07cec-3f4b-419f-a2cb-f8983f3eb47e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:08.076656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a07cec-3f4b-419f-a2cb-f8983f3eb47e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:08.105764 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3a07cec-3f4b-419f-a2cb-f8983f3eb47e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044522 Aug 22 19:40:08.106305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 683/1507] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:09.117973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0e2ec62f-5696-4879-a833-3f5911ac58ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:09.120145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0e2ec62f-5696-4879-a833-3f5911ac58ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:09.126455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2ec62f-5696-4879-a833-3f5911ac58ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:09.126927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2ec62f-5696-4879-a833-3f5911ac58ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:09.127355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2ec62f-5696-4879-a833-3f5911ac58ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:09.128069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2ec62f-5696-4879-a833-3f5911ac58ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:09.128514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2ec62f-5696-4879-a833-3f5911ac58ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:09.128936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2ec62f-5696-4879-a833-3f5911ac58ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:09.158161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0e2ec62f-5696-4879-a833-3f5911ac58ec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Aug 22 19:40:09.158826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 825/1508] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:09 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:10.170974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78bbdf3e-08a3-47a9-9008-af2c696d890c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:10.173150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78bbdf3e-08a3-47a9-9008-af2c696d890c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:10.179559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78bbdf3e-08a3-47a9-9008-af2c696d890c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:10.180085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78bbdf3e-08a3-47a9-9008-af2c696d890c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:10.180518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78bbdf3e-08a3-47a9-9008-af2c696d890c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:10.181207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78bbdf3e-08a3-47a9-9008-af2c696d890c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:10.182387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78bbdf3e-08a3-47a9-9008-af2c696d890c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:10.182815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78bbdf3e-08a3-47a9-9008-af2c696d890c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:10.211272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78bbdf3e-08a3-47a9-9008-af2c696d890c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 Aug 22 19:40:10.211837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 684/1509] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:11.223460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dd137311-1496-4464-9b4a-0174d6b797c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:11.225675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dd137311-1496-4464-9b4a-0174d6b797c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:11.232051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd137311-1496-4464-9b4a-0174d6b797c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:11.232527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd137311-1496-4464-9b4a-0174d6b797c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:11.232993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd137311-1496-4464-9b4a-0174d6b797c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:11.233680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd137311-1496-4464-9b4a-0174d6b797c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:11.234130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd137311-1496-4464-9b4a-0174d6b797c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:11.234549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd137311-1496-4464-9b4a-0174d6b797c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:11.263300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dd137311-1496-4464-9b4a-0174d6b797c0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043734 Aug 22 19:40:11.263809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 826/1510] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:12.275335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-992a78b8-2355-4f8a-8158-e017908b600b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:12.277554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-992a78b8-2355-4f8a-8158-e017908b600b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:12.283915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-992a78b8-2355-4f8a-8158-e017908b600b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:12.284397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-992a78b8-2355-4f8a-8158-e017908b600b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:12.284831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-992a78b8-2355-4f8a-8158-e017908b600b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:12.285520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-992a78b8-2355-4f8a-8158-e017908b600b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:12.285971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-992a78b8-2355-4f8a-8158-e017908b600b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:12.286394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-992a78b8-2355-4f8a-8158-e017908b600b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:12.314806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-992a78b8-2355-4f8a-8158-e017908b600b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043449 Aug 22 19:40:12.315338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 685/1511] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:13.327340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0f493847-a2a9-4714-a92c-d0e9bbe4055b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:13.329487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0f493847-a2a9-4714-a92c-d0e9bbe4055b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:13.336200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f493847-a2a9-4714-a92c-d0e9bbe4055b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:13.336681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f493847-a2a9-4714-a92c-d0e9bbe4055b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:13.337115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f493847-a2a9-4714-a92c-d0e9bbe4055b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:13.338386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f493847-a2a9-4714-a92c-d0e9bbe4055b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:13.338832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f493847-a2a9-4714-a92c-d0e9bbe4055b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:13.339257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f493847-a2a9-4714-a92c-d0e9bbe4055b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:13.342801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=90 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:13.368634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0f493847-a2a9-4714-a92c-d0e9bbe4055b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Aug 22 19:40:13.369188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 827/1512] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:14.380460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-765d56b2-dcdb-4358-a3e2-c920bda08a1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:14.382580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-765d56b2-dcdb-4358-a3e2-c920bda08a1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:14.389471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-765d56b2-dcdb-4358-a3e2-c920bda08a1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:14.389948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-765d56b2-dcdb-4358-a3e2-c920bda08a1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:14.390375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-765d56b2-dcdb-4358-a3e2-c920bda08a1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:14.391140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-765d56b2-dcdb-4358-a3e2-c920bda08a1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:14.391763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-765d56b2-dcdb-4358-a3e2-c920bda08a1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:14.392213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-765d56b2-dcdb-4358-a3e2-c920bda08a1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:14.421705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-765d56b2-dcdb-4358-a3e2-c920bda08a1a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Aug 22 19:40:14.422176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 686/1513] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:15.432930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6436f433-2184-4eb3-97cb-0be729f27aa5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:15.435049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6436f433-2184-4eb3-97cb-0be729f27aa5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:15.441559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6436f433-2184-4eb3-97cb-0be729f27aa5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:15.442070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6436f433-2184-4eb3-97cb-0be729f27aa5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:15.442596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6436f433-2184-4eb3-97cb-0be729f27aa5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:15.443286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6436f433-2184-4eb3-97cb-0be729f27aa5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:15.443821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6436f433-2184-4eb3-97cb-0be729f27aa5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:15.444268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6436f433-2184-4eb3-97cb-0be729f27aa5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:15.474357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6436f433-2184-4eb3-97cb-0be729f27aa5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Aug 22 19:40:15.474908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 828/1514] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:15 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:16.487052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e5cb0e0e-7606-450f-84d5-2fbb7eeb2892 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:16.489417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e5cb0e0e-7606-450f-84d5-2fbb7eeb2892 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:16.496371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5cb0e0e-7606-450f-84d5-2fbb7eeb2892 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:16.496848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5cb0e0e-7606-450f-84d5-2fbb7eeb2892 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:16.497282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5cb0e0e-7606-450f-84d5-2fbb7eeb2892 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:16.497975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5cb0e0e-7606-450f-84d5-2fbb7eeb2892 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:16.498425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5cb0e0e-7606-450f-84d5-2fbb7eeb2892 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:16.498847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5cb0e0e-7606-450f-84d5-2fbb7eeb2892 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:16.501186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:16.529175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e5cb0e0e-7606-450f-84d5-2fbb7eeb2892 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Aug 22 19:40:16.529785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 687/1515] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:17.542050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8cc713fd-125f-4821-b431-cc91e5a859da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:17.544215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8cc713fd-125f-4821-b431-cc91e5a859da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:17.550467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cc713fd-125f-4821-b431-cc91e5a859da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:17.550939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cc713fd-125f-4821-b431-cc91e5a859da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:17.551366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cc713fd-125f-4821-b431-cc91e5a859da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:17.552077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cc713fd-125f-4821-b431-cc91e5a859da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:17.552520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cc713fd-125f-4821-b431-cc91e5a859da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:17.552936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8cc713fd-125f-4821-b431-cc91e5a859da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:17.582287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8cc713fd-125f-4821-b431-cc91e5a859da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Aug 22 19:40:17.583098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 829/1516] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:18.594951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6698b97-568b-4c98-b1fa-ee45ad4e19fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:18.597109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6698b97-568b-4c98-b1fa-ee45ad4e19fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:18.603616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6698b97-568b-4c98-b1fa-ee45ad4e19fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:18.604133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6698b97-568b-4c98-b1fa-ee45ad4e19fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:18.604563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6698b97-568b-4c98-b1fa-ee45ad4e19fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:18.605248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6698b97-568b-4c98-b1fa-ee45ad4e19fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:18.605695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6698b97-568b-4c98-b1fa-ee45ad4e19fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:18.606111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6698b97-568b-4c98-b1fa-ee45ad4e19fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:18.635433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6698b97-568b-4c98-b1fa-ee45ad4e19fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 22 19:40:18.635998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 688/1517] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:19.647879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-acef4451-6494-4514-8f00-860a9982016a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:19.650050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-acef4451-6494-4514-8f00-860a9982016a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:19.656890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-acef4451-6494-4514-8f00-860a9982016a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:19.657368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-acef4451-6494-4514-8f00-860a9982016a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:19.657799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-acef4451-6494-4514-8f00-860a9982016a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:19.658482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-acef4451-6494-4514-8f00-860a9982016a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:19.658931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-acef4451-6494-4514-8f00-860a9982016a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:19.659353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-acef4451-6494-4514-8f00-860a9982016a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:19.690338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-acef4451-6494-4514-8f00-860a9982016a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046581 Aug 22 19:40:19.690892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 830/1518] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:20.702527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48343327-8e4f-481b-8393-5453a7f0ad34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:20.704672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48343327-8e4f-481b-8393-5453a7f0ad34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:20.711258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48343327-8e4f-481b-8393-5453a7f0ad34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:20.711767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48343327-8e4f-481b-8393-5453a7f0ad34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:20.712197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48343327-8e4f-481b-8393-5453a7f0ad34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:20.712882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48343327-8e4f-481b-8393-5453a7f0ad34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:20.713327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48343327-8e4f-481b-8393-5453a7f0ad34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:20.713746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48343327-8e4f-481b-8393-5453a7f0ad34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:20.743786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48343327-8e4f-481b-8393-5453a7f0ad34 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045143 Aug 22 19:40:20.744918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 689/1519] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:21.756673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-778114fe-e6fa-40af-8386-71d9f91ac7f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:21.759176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-778114fe-e6fa-40af-8386-71d9f91ac7f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:21.762072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=30 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:21.768153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-778114fe-e6fa-40af-8386-71d9f91ac7f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:21.768640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-778114fe-e6fa-40af-8386-71d9f91ac7f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:21.769063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-778114fe-e6fa-40af-8386-71d9f91ac7f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:21.769757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-778114fe-e6fa-40af-8386-71d9f91ac7f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:21.770203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-778114fe-e6fa-40af-8386-71d9f91ac7f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:21.770625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-778114fe-e6fa-40af-8386-71d9f91ac7f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:21.799129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-778114fe-e6fa-40af-8386-71d9f91ac7f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046996 Aug 22 19:40:21.799699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 831/1520] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:22.811360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-430a959b-35d9-4093-b0e1-35231f68bc3e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:22.813535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-430a959b-35d9-4093-b0e1-35231f68bc3e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:22.815810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:22.821090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-430a959b-35d9-4093-b0e1-35231f68bc3e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:22.821592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-430a959b-35d9-4093-b0e1-35231f68bc3e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:22.822521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-430a959b-35d9-4093-b0e1-35231f68bc3e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:22.823207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-430a959b-35d9-4093-b0e1-35231f68bc3e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:22.823671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-430a959b-35d9-4093-b0e1-35231f68bc3e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:22.824092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-430a959b-35d9-4093-b0e1-35231f68bc3e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:22.853186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-430a959b-35d9-4093-b0e1-35231f68bc3e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046356 Aug 22 19:40:22.855514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 690/1521] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:23.824337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:40:23.825046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:40:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:40:23.866433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d8b0b32e-c6a6-4a43-9547-e304d8bcaa62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:23.868580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d8b0b32e-c6a6-4a43-9547-e304d8bcaa62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:23.875310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8b0b32e-c6a6-4a43-9547-e304d8bcaa62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:23.875846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8b0b32e-c6a6-4a43-9547-e304d8bcaa62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:23.876288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8b0b32e-c6a6-4a43-9547-e304d8bcaa62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:23.876982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8b0b32e-c6a6-4a43-9547-e304d8bcaa62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:23.877435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8b0b32e-c6a6-4a43-9547-e304d8bcaa62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:23.877860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8b0b32e-c6a6-4a43-9547-e304d8bcaa62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:23.907372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d8b0b32e-c6a6-4a43-9547-e304d8bcaa62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Aug 22 19:40:23.907971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 832/1522] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:24.920470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-710775a1-a00d-4eae-9a25-24c83e3212dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:24.923070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-710775a1-a00d-4eae-9a25-24c83e3212dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:24.929774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-710775a1-a00d-4eae-9a25-24c83e3212dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:24.930247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-710775a1-a00d-4eae-9a25-24c83e3212dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:24.930774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-710775a1-a00d-4eae-9a25-24c83e3212dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:24.932071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-710775a1-a00d-4eae-9a25-24c83e3212dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:24.932691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-710775a1-a00d-4eae-9a25-24c83e3212dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:24.933116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-710775a1-a00d-4eae-9a25-24c83e3212dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:24.962475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-710775a1-a00d-4eae-9a25-24c83e3212dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046711 Aug 22 19:40:24.963008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 691/1523] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:40:25.974589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7bfdd511-4448-45c2-9fbf-e660a4607638 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:25.976866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7bfdd511-4448-45c2-9fbf-e660a4607638 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:25.983960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bfdd511-4448-45c2-9fbf-e660a4607638 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:25.984432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bfdd511-4448-45c2-9fbf-e660a4607638 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:25.984861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bfdd511-4448-45c2-9fbf-e660a4607638 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:25.985546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bfdd511-4448-45c2-9fbf-e660a4607638 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:25.985994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bfdd511-4448-45c2-9fbf-e660a4607638 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:25.986415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bfdd511-4448-45c2-9fbf-e660a4607638 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:26.014960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7bfdd511-4448-45c2-9fbf-e660a4607638 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Aug 22 19:40:26.015500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 833/1524] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:27.027163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-49b4a5c4-0781-4a05-9171-a87d62f78f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:27.029511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-49b4a5c4-0781-4a05-9171-a87d62f78f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:27.035928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b4a5c4-0781-4a05-9171-a87d62f78f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:27.036410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b4a5c4-0781-4a05-9171-a87d62f78f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:27.036842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b4a5c4-0781-4a05-9171-a87d62f78f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:27.037559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b4a5c4-0781-4a05-9171-a87d62f78f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:27.038011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b4a5c4-0781-4a05-9171-a87d62f78f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:27.038434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-49b4a5c4-0781-4a05-9171-a87d62f78f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:27.067222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-49b4a5c4-0781-4a05-9171-a87d62f78f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Aug 22 19:40:27.067776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 692/1525] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:27 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:28.080003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-355bb5a3-01b4-417b-b850-92cb28555eab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:28.082144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-355bb5a3-01b4-417b-b850-92cb28555eab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:28.089426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-355bb5a3-01b4-417b-b850-92cb28555eab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:28.089899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-355bb5a3-01b4-417b-b850-92cb28555eab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:28.090325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-355bb5a3-01b4-417b-b850-92cb28555eab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:28.091006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-355bb5a3-01b4-417b-b850-92cb28555eab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:28.091450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-355bb5a3-01b4-417b-b850-92cb28555eab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:28.091888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-355bb5a3-01b4-417b-b850-92cb28555eab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:28.120287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-355bb5a3-01b4-417b-b850-92cb28555eab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Aug 22 19:40:28.120843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 834/1526] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:29.132348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84ffd8ff-2d7a-46fd-8d3c-dcbb6d7914bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:29.134477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84ffd8ff-2d7a-46fd-8d3c-dcbb6d7914bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:29.141308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffd8ff-2d7a-46fd-8d3c-dcbb6d7914bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:29.141855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffd8ff-2d7a-46fd-8d3c-dcbb6d7914bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:29.142287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffd8ff-2d7a-46fd-8d3c-dcbb6d7914bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:29.142984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffd8ff-2d7a-46fd-8d3c-dcbb6d7914bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:29.143432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffd8ff-2d7a-46fd-8d3c-dcbb6d7914bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:29.143887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84ffd8ff-2d7a-46fd-8d3c-dcbb6d7914bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:29.172714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84ffd8ff-2d7a-46fd-8d3c-dcbb6d7914bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Aug 22 19:40:29.173255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 693/1527] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:29 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:30.184576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8c5ec577-6771-42bd-ad7f-66d0dc67328b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:30.186704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8c5ec577-6771-42bd-ad7f-66d0dc67328b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:30.193145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c5ec577-6771-42bd-ad7f-66d0dc67328b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:30.193630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c5ec577-6771-42bd-ad7f-66d0dc67328b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:30.194070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c5ec577-6771-42bd-ad7f-66d0dc67328b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:30.194762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c5ec577-6771-42bd-ad7f-66d0dc67328b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:30.195217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c5ec577-6771-42bd-ad7f-66d0dc67328b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:30.195661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c5ec577-6771-42bd-ad7f-66d0dc67328b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:30.224785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8c5ec577-6771-42bd-ad7f-66d0dc67328b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Aug 22 19:40:30.225328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 835/1528] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:31.237193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-727e28ba-eb46-4801-9082-5296d0329d48 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:31.239385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-727e28ba-eb46-4801-9082-5296d0329d48 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:31.245681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-727e28ba-eb46-4801-9082-5296d0329d48 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:31.246153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-727e28ba-eb46-4801-9082-5296d0329d48 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:31.246581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-727e28ba-eb46-4801-9082-5296d0329d48 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:31.247260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-727e28ba-eb46-4801-9082-5296d0329d48 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:31.247729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-727e28ba-eb46-4801-9082-5296d0329d48 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:31.248147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-727e28ba-eb46-4801-9082-5296d0329d48 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:31.276998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-727e28ba-eb46-4801-9082-5296d0329d48 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043098 Aug 22 19:40:31.277544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 694/1529] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:32.288952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-65c0e95a-028a-4a60-be96-d6ff1c6eb571 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:32.291059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-65c0e95a-028a-4a60-be96-d6ff1c6eb571 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:32.297116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65c0e95a-028a-4a60-be96-d6ff1c6eb571 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:32.297593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65c0e95a-028a-4a60-be96-d6ff1c6eb571 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:32.298024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65c0e95a-028a-4a60-be96-d6ff1c6eb571 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:32.298712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65c0e95a-028a-4a60-be96-d6ff1c6eb571 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:32.299160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65c0e95a-028a-4a60-be96-d6ff1c6eb571 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:32.299582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-65c0e95a-028a-4a60-be96-d6ff1c6eb571 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:32.328111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-65c0e95a-028a-4a60-be96-d6ff1c6eb571 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043181 Aug 22 19:40:32.328657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 836/1530] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:33.341124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21ce88c0-ad95-4369-9c26-34a65ff458e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:33.343281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21ce88c0-ad95-4369-9c26-34a65ff458e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:33.349644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21ce88c0-ad95-4369-9c26-34a65ff458e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:33.350128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21ce88c0-ad95-4369-9c26-34a65ff458e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:33.350567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21ce88c0-ad95-4369-9c26-34a65ff458e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:33.351258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21ce88c0-ad95-4369-9c26-34a65ff458e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:33.351739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21ce88c0-ad95-4369-9c26-34a65ff458e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:33.352171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21ce88c0-ad95-4369-9c26-34a65ff458e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:33.381641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21ce88c0-ad95-4369-9c26-34a65ff458e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045106 Aug 22 19:40:33.382191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 695/1531] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:34.393510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6633f3fa-87f0-4797-aa28-c8e3adc8d0ba tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:34.395634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6633f3fa-87f0-4797-aa28-c8e3adc8d0ba tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:34.402639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6633f3fa-87f0-4797-aa28-c8e3adc8d0ba tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:34.403136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6633f3fa-87f0-4797-aa28-c8e3adc8d0ba tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:34.403565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6633f3fa-87f0-4797-aa28-c8e3adc8d0ba tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:34.404271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6633f3fa-87f0-4797-aa28-c8e3adc8d0ba tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:34.404719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6633f3fa-87f0-4797-aa28-c8e3adc8d0ba tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:34.405143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6633f3fa-87f0-4797-aa28-c8e3adc8d0ba tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:34.434042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6633f3fa-87f0-4797-aa28-c8e3adc8d0ba tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Aug 22 19:40:34.434590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 837/1532] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:34 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:35.447412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4fb0c13a-7982-4f7e-b982-2a647418063a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:35.450257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4fb0c13a-7982-4f7e-b982-2a647418063a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:35.456283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb0c13a-7982-4f7e-b982-2a647418063a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:35.456759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb0c13a-7982-4f7e-b982-2a647418063a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:35.457192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb0c13a-7982-4f7e-b982-2a647418063a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:35.458179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb0c13a-7982-4f7e-b982-2a647418063a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:35.458624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb0c13a-7982-4f7e-b982-2a647418063a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:35.459045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb0c13a-7982-4f7e-b982-2a647418063a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:35.487517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4fb0c13a-7982-4f7e-b982-2a647418063a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045991 Aug 22 19:40:35.488088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 696/1533] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:36.500152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-386e4d18-b7a9-4af0-a166-c10b62832810 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:36.502311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-386e4d18-b7a9-4af0-a166-c10b62832810 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:36.508797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-386e4d18-b7a9-4af0-a166-c10b62832810 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:36.509277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-386e4d18-b7a9-4af0-a166-c10b62832810 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:36.509710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-386e4d18-b7a9-4af0-a166-c10b62832810 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:36.510922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-386e4d18-b7a9-4af0-a166-c10b62832810 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:36.511352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-386e4d18-b7a9-4af0-a166-c10b62832810 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:36.511804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-386e4d18-b7a9-4af0-a166-c10b62832810 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:36.541142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-386e4d18-b7a9-4af0-a166-c10b62832810 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044987 Aug 22 19:40:36.541719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 838/1534] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:37.553433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4de699d3-7e16-4ee6-968f-910414a8edc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:37.555599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4de699d3-7e16-4ee6-968f-910414a8edc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:37.561931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de699d3-7e16-4ee6-968f-910414a8edc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:37.562412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de699d3-7e16-4ee6-968f-910414a8edc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:37.562848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de699d3-7e16-4ee6-968f-910414a8edc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:37.563544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de699d3-7e16-4ee6-968f-910414a8edc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:37.564023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de699d3-7e16-4ee6-968f-910414a8edc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:37.564452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4de699d3-7e16-4ee6-968f-910414a8edc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:37.593743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4de699d3-7e16-4ee6-968f-910414a8edc9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Aug 22 19:40:37.594281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 697/1535] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:38.605860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a88bdf92-c9de-4a1b-aa54-55ab6f7ac154 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:38.607992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a88bdf92-c9de-4a1b-aa54-55ab6f7ac154 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:38.614815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a88bdf92-c9de-4a1b-aa54-55ab6f7ac154 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:38.615288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a88bdf92-c9de-4a1b-aa54-55ab6f7ac154 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:38.615747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a88bdf92-c9de-4a1b-aa54-55ab6f7ac154 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:38.616429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a88bdf92-c9de-4a1b-aa54-55ab6f7ac154 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:38.616875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a88bdf92-c9de-4a1b-aa54-55ab6f7ac154 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:38.617294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a88bdf92-c9de-4a1b-aa54-55ab6f7ac154 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:38.646267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a88bdf92-c9de-4a1b-aa54-55ab6f7ac154 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Aug 22 19:40:38.646818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 839/1536] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:39.659035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5e4680f-54ca-4e37-b499-0a409ff52929 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:39.661522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5e4680f-54ca-4e37-b499-0a409ff52929 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:39.668555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5e4680f-54ca-4e37-b499-0a409ff52929 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:39.669032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5e4680f-54ca-4e37-b499-0a409ff52929 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:39.669461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5e4680f-54ca-4e37-b499-0a409ff52929 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:39.670141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5e4680f-54ca-4e37-b499-0a409ff52929 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:39.670592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5e4680f-54ca-4e37-b499-0a409ff52929 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:39.671030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5e4680f-54ca-4e37-b499-0a409ff52929 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:39.700428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5e4680f-54ca-4e37-b499-0a409ff52929 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Aug 22 19:40:39.700975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 698/1537] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:40.712328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ef847105-8eae-4b9f-9cc5-59885ba65b46 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:40.714445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ef847105-8eae-4b9f-9cc5-59885ba65b46 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:40.720753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef847105-8eae-4b9f-9cc5-59885ba65b46 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:40.721231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef847105-8eae-4b9f-9cc5-59885ba65b46 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:40.721657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef847105-8eae-4b9f-9cc5-59885ba65b46 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:40.722339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef847105-8eae-4b9f-9cc5-59885ba65b46 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:40.722787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef847105-8eae-4b9f-9cc5-59885ba65b46 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:40.723201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef847105-8eae-4b9f-9cc5-59885ba65b46 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:40.752237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ef847105-8eae-4b9f-9cc5-59885ba65b46 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Aug 22 19:40:40.752791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 840/1538] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:41.845559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db9d0edb-ac1c-4ed4-963d-5b24f104d31c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:41.847976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db9d0edb-ac1c-4ed4-963d-5b24f104d31c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:41.854341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9d0edb-ac1c-4ed4-963d-5b24f104d31c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:41.854812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9d0edb-ac1c-4ed4-963d-5b24f104d31c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:41.855240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9d0edb-ac1c-4ed4-963d-5b24f104d31c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:41.855949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9d0edb-ac1c-4ed4-963d-5b24f104d31c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:41.856397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9d0edb-ac1c-4ed4-963d-5b24f104d31c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:41.856815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db9d0edb-ac1c-4ed4-963d-5b24f104d31c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:41.887042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db9d0edb-ac1c-4ed4-963d-5b24f104d31c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126497 Aug 22 19:40:41.887587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 699/1539] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:42.898552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9c05df7e-f36c-423f-913c-cde69b9d566e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:42.900717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9c05df7e-f36c-423f-913c-cde69b9d566e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:42.906925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c05df7e-f36c-423f-913c-cde69b9d566e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:42.907396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c05df7e-f36c-423f-913c-cde69b9d566e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:42.907874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c05df7e-f36c-423f-913c-cde69b9d566e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:42.908611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c05df7e-f36c-423f-913c-cde69b9d566e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:42.909060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c05df7e-f36c-423f-913c-cde69b9d566e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:42.909477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c05df7e-f36c-423f-913c-cde69b9d566e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:42.937981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9c05df7e-f36c-423f-913c-cde69b9d566e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043417 Aug 22 19:40:42.938523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 841/1540] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:43.950661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b255ebaa-2c30-4bd5-a8a0-e9c9ac147fb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:43.952882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b255ebaa-2c30-4bd5-a8a0-e9c9ac147fb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:43.959508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b255ebaa-2c30-4bd5-a8a0-e9c9ac147fb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:43.960020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b255ebaa-2c30-4bd5-a8a0-e9c9ac147fb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:43.960455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b255ebaa-2c30-4bd5-a8a0-e9c9ac147fb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:43.961146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b255ebaa-2c30-4bd5-a8a0-e9c9ac147fb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:43.961594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b255ebaa-2c30-4bd5-a8a0-e9c9ac147fb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:43.962014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b255ebaa-2c30-4bd5-a8a0-e9c9ac147fb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:43.990545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b255ebaa-2c30-4bd5-a8a0-e9c9ac147fb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Aug 22 19:40:43.991076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 700/1541] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:43 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:45.002720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2551abec-f6e4-4f11-b58b-7b2e445334d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:45.004898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2551abec-f6e4-4f11-b58b-7b2e445334d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:45.011316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2551abec-f6e4-4f11-b58b-7b2e445334d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:45.011831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2551abec-f6e4-4f11-b58b-7b2e445334d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:45.012261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2551abec-f6e4-4f11-b58b-7b2e445334d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:45.012942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2551abec-f6e4-4f11-b58b-7b2e445334d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:45.013385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2551abec-f6e4-4f11-b58b-7b2e445334d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:45.013803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2551abec-f6e4-4f11-b58b-7b2e445334d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:45.017283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=90 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:45.043409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2551abec-f6e4-4f11-b58b-7b2e445334d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 Aug 22 19:40:45.044004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 842/1542] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:46.055761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c698dc4-1e2f-4be9-98af-9139eb2f166f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:46.057924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c698dc4-1e2f-4be9-98af-9139eb2f166f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:46.064340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c698dc4-1e2f-4be9-98af-9139eb2f166f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:46.064813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c698dc4-1e2f-4be9-98af-9139eb2f166f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:46.065243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c698dc4-1e2f-4be9-98af-9139eb2f166f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:46.065926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c698dc4-1e2f-4be9-98af-9139eb2f166f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:46.066372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c698dc4-1e2f-4be9-98af-9139eb2f166f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:46.066793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c698dc4-1e2f-4be9-98af-9139eb2f166f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:46.096372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c698dc4-1e2f-4be9-98af-9139eb2f166f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 Aug 22 19:40:46.096915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 701/1543] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:47.109006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8bdf6d22-3c3c-46cc-b68e-6d9611484499 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:47.111159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8bdf6d22-3c3c-46cc-b68e-6d9611484499 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:47.117726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bdf6d22-3c3c-46cc-b68e-6d9611484499 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:47.118213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bdf6d22-3c3c-46cc-b68e-6d9611484499 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:47.118645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bdf6d22-3c3c-46cc-b68e-6d9611484499 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:47.120022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bdf6d22-3c3c-46cc-b68e-6d9611484499 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:47.120485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bdf6d22-3c3c-46cc-b68e-6d9611484499 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:47.120913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8bdf6d22-3c3c-46cc-b68e-6d9611484499 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:47.149308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8bdf6d22-3c3c-46cc-b68e-6d9611484499 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Aug 22 19:40:47.149877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 843/1544] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:48.160991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99d7c9f1-a993-4aed-9a40-199283dd64f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:48.163053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99d7c9f1-a993-4aed-9a40-199283dd64f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:48.170054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d7c9f1-a993-4aed-9a40-199283dd64f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:48.170529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d7c9f1-a993-4aed-9a40-199283dd64f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:48.170957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d7c9f1-a993-4aed-9a40-199283dd64f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:48.171658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d7c9f1-a993-4aed-9a40-199283dd64f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:48.172106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d7c9f1-a993-4aed-9a40-199283dd64f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:48.172524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d7c9f1-a993-4aed-9a40-199283dd64f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:48.176023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:48.200636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99d7c9f1-a993-4aed-9a40-199283dd64f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Aug 22 19:40:48.201168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 702/1545] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:40:49.213733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1c4913c4-c37f-405a-8ab0-90e5c1c7f815 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:49.215885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1c4913c4-c37f-405a-8ab0-90e5c1c7f815 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:49.222298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c4913c4-c37f-405a-8ab0-90e5c1c7f815 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:49.222771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c4913c4-c37f-405a-8ab0-90e5c1c7f815 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:49.223195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c4913c4-c37f-405a-8ab0-90e5c1c7f815 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:49.223898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c4913c4-c37f-405a-8ab0-90e5c1c7f815 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:49.224341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c4913c4-c37f-405a-8ab0-90e5c1c7f815 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:49.224757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c4913c4-c37f-405a-8ab0-90e5c1c7f815 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:49.252859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1c4913c4-c37f-405a-8ab0-90e5c1c7f815 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 Aug 22 19:40:49.253406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 844/1546] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:50.265281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b33f481-bd3f-4b2d-a757-46f646865509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:50.267331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b33f481-bd3f-4b2d-a757-46f646865509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:50.273776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b33f481-bd3f-4b2d-a757-46f646865509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:50.274279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b33f481-bd3f-4b2d-a757-46f646865509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:50.274707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b33f481-bd3f-4b2d-a757-46f646865509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:50.275933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b33f481-bd3f-4b2d-a757-46f646865509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:50.276423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b33f481-bd3f-4b2d-a757-46f646865509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:50.276842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b33f481-bd3f-4b2d-a757-46f646865509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:50.305636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b33f481-bd3f-4b2d-a757-46f646865509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Aug 22 19:40:50.306181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 703/1547] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:51.317848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9ffb94a0-fca7-4aed-bc3b-17ae49b43e64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:51.319903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9ffb94a0-fca7-4aed-bc3b-17ae49b43e64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:51.326736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ffb94a0-fca7-4aed-bc3b-17ae49b43e64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:51.327213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ffb94a0-fca7-4aed-bc3b-17ae49b43e64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:51.327671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ffb94a0-fca7-4aed-bc3b-17ae49b43e64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:51.328358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ffb94a0-fca7-4aed-bc3b-17ae49b43e64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:51.328810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ffb94a0-fca7-4aed-bc3b-17ae49b43e64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:51.329228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ffb94a0-fca7-4aed-bc3b-17ae49b43e64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:51.358277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9ffb94a0-fca7-4aed-bc3b-17ae49b43e64 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Aug 22 19:40:51.358820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 845/1548] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:52.370208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-521a8269-513d-4aa4-9bcf-2e8931cccb08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:52.372327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-521a8269-513d-4aa4-9bcf-2e8931cccb08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:52.378570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-521a8269-513d-4aa4-9bcf-2e8931cccb08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:52.379051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-521a8269-513d-4aa4-9bcf-2e8931cccb08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:52.379485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-521a8269-513d-4aa4-9bcf-2e8931cccb08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:52.380198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-521a8269-513d-4aa4-9bcf-2e8931cccb08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:52.380656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-521a8269-513d-4aa4-9bcf-2e8931cccb08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:52.381081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-521a8269-513d-4aa4-9bcf-2e8931cccb08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:52.408929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-521a8269-513d-4aa4-9bcf-2e8931cccb08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043374 Aug 22 19:40:52.409462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 704/1549] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:53.422114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7cd6f61a-05f5-4fa8-80a7-2e424fe4b4d8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:53.424276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7cd6f61a-05f5-4fa8-80a7-2e424fe4b4d8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:53.426561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=30 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:53.431779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cd6f61a-05f5-4fa8-80a7-2e424fe4b4d8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:53.432264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cd6f61a-05f5-4fa8-80a7-2e424fe4b4d8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:53.432697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cd6f61a-05f5-4fa8-80a7-2e424fe4b4d8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:53.433384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cd6f61a-05f5-4fa8-80a7-2e424fe4b4d8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:53.433833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cd6f61a-05f5-4fa8-80a7-2e424fe4b4d8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:53.434254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7cd6f61a-05f5-4fa8-80a7-2e424fe4b4d8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:53.464787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7cd6f61a-05f5-4fa8-80a7-2e424fe4b4d8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046541 Aug 22 19:40:53.465364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 846/1550] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:54.476905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-daf126f0-9556-4beb-a5e6-e7f6889baf04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:54.479036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-daf126f0-9556-4beb-a5e6-e7f6889baf04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:54.481332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:54.486536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf126f0-9556-4beb-a5e6-e7f6889baf04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:54.487009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf126f0-9556-4beb-a5e6-e7f6889baf04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:54.487440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf126f0-9556-4beb-a5e6-e7f6889baf04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:54.488163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf126f0-9556-4beb-a5e6-e7f6889baf04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:54.488610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf126f0-9556-4beb-a5e6-e7f6889baf04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:54.489031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daf126f0-9556-4beb-a5e6-e7f6889baf04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:54.517585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-daf126f0-9556-4beb-a5e6-e7f6889baf04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Aug 22 19:40:54.518101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 705/1551] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:55.529732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fcd491f7-dfa3-4efd-ae31-b36e8ab92e37 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:55.531896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fcd491f7-dfa3-4efd-ae31-b36e8ab92e37 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:55.538366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcd491f7-dfa3-4efd-ae31-b36e8ab92e37 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:55.538846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcd491f7-dfa3-4efd-ae31-b36e8ab92e37 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:55.539283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcd491f7-dfa3-4efd-ae31-b36e8ab92e37 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:55.540004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcd491f7-dfa3-4efd-ae31-b36e8ab92e37 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:55.540450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcd491f7-dfa3-4efd-ae31-b36e8ab92e37 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:55.540875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcd491f7-dfa3-4efd-ae31-b36e8ab92e37 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:55.569152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fcd491f7-dfa3-4efd-ae31-b36e8ab92e37 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Aug 22 19:40:55.569690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 847/1552] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:40:56.582556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d3a3b58-f247-4fda-9165-3b7c0ff0fb55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:56.584703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d3a3b58-f247-4fda-9165-3b7c0ff0fb55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:56.591840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a3b58-f247-4fda-9165-3b7c0ff0fb55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:56.592316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a3b58-f247-4fda-9165-3b7c0ff0fb55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:56.592745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a3b58-f247-4fda-9165-3b7c0ff0fb55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:56.593425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a3b58-f247-4fda-9165-3b7c0ff0fb55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:56.593872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a3b58-f247-4fda-9165-3b7c0ff0fb55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:56.594287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d3a3b58-f247-4fda-9165-3b7c0ff0fb55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:56.622013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d3a3b58-f247-4fda-9165-3b7c0ff0fb55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043710 Aug 22 19:40:56.622547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 706/1553] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:57.635146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7f81d844-65cf-439e-872e-9c40a6040dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:57.637354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7f81d844-65cf-439e-872e-9c40a6040dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:57.643235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f81d844-65cf-439e-872e-9c40a6040dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:57.643743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f81d844-65cf-439e-872e-9c40a6040dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:57.644181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f81d844-65cf-439e-872e-9c40a6040dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:57.644868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f81d844-65cf-439e-872e-9c40a6040dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:57.645325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f81d844-65cf-439e-872e-9c40a6040dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:57.645747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f81d844-65cf-439e-872e-9c40a6040dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:57.674319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7f81d844-65cf-439e-872e-9c40a6040dec tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Aug 22 19:40:57.674869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 848/1554] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:58.686279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f61b7dc-1995-4c2a-8056-51eb249c570e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:58.688487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8f61b7dc-1995-4c2a-8056-51eb249c570e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:58.694502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f61b7dc-1995-4c2a-8056-51eb249c570e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:58.694980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f61b7dc-1995-4c2a-8056-51eb249c570e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:58.695462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f61b7dc-1995-4c2a-8056-51eb249c570e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:58.696182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f61b7dc-1995-4c2a-8056-51eb249c570e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:58.696631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f61b7dc-1995-4c2a-8056-51eb249c570e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:58.697051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f61b7dc-1995-4c2a-8056-51eb249c570e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:58.726167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f61b7dc-1995-4c2a-8056-51eb249c570e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Aug 22 19:40:58.726714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 707/1555] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:40:59.738326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0d2ff837-cfa3-49da-a54d-6fb1d1625cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:40:59.740499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0d2ff837-cfa3-49da-a54d-6fb1d1625cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:40:59.747414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d2ff837-cfa3-49da-a54d-6fb1d1625cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:59.747911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d2ff837-cfa3-49da-a54d-6fb1d1625cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:59.748346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d2ff837-cfa3-49da-a54d-6fb1d1625cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:59.749035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d2ff837-cfa3-49da-a54d-6fb1d1625cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:40:59.749483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d2ff837-cfa3-49da-a54d-6fb1d1625cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:40:59.749902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d2ff837-cfa3-49da-a54d-6fb1d1625cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:40:59.778152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0d2ff837-cfa3-49da-a54d-6fb1d1625cd3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043699 Aug 22 19:40:59.778741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 849/1556] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:40:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:00.789593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83224312-cf3f-462a-893c-74b1d92bfcf3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:00.792438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83224312-cf3f-462a-893c-74b1d92bfcf3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:00.798872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83224312-cf3f-462a-893c-74b1d92bfcf3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:00.799356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83224312-cf3f-462a-893c-74b1d92bfcf3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:00.799910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83224312-cf3f-462a-893c-74b1d92bfcf3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:00.800609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83224312-cf3f-462a-893c-74b1d92bfcf3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:00.801060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83224312-cf3f-462a-893c-74b1d92bfcf3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:00.801484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83224312-cf3f-462a-893c-74b1d92bfcf3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:00.829905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83224312-cf3f-462a-893c-74b1d92bfcf3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Aug 22 19:41:00.830457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 708/1557] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:01.842585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8c3d1d03-7246-4337-802c-1bd53bdbb497 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:01.844698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8c3d1d03-7246-4337-802c-1bd53bdbb497 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:01.850574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c3d1d03-7246-4337-802c-1bd53bdbb497 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:01.851057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c3d1d03-7246-4337-802c-1bd53bdbb497 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:01.851494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c3d1d03-7246-4337-802c-1bd53bdbb497 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:01.852217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c3d1d03-7246-4337-802c-1bd53bdbb497 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:01.852672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c3d1d03-7246-4337-802c-1bd53bdbb497 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:01.853611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c3d1d03-7246-4337-802c-1bd53bdbb497 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:01.882033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8c3d1d03-7246-4337-802c-1bd53bdbb497 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 Aug 22 19:41:01.882580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 850/1558] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:02.894942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cfeab695-3678-42ed-8d07-580d6f5da072 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:02.897052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cfeab695-3678-42ed-8d07-580d6f5da072 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:02.904942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfeab695-3678-42ed-8d07-580d6f5da072 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:02.905417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfeab695-3678-42ed-8d07-580d6f5da072 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:02.905847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfeab695-3678-42ed-8d07-580d6f5da072 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:02.906559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfeab695-3678-42ed-8d07-580d6f5da072 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:02.907007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfeab695-3678-42ed-8d07-580d6f5da072 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:02.907426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cfeab695-3678-42ed-8d07-580d6f5da072 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:02.935751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cfeab695-3678-42ed-8d07-580d6f5da072 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Aug 22 19:41:02.936288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 709/1559] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:41:03.948169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-717494bc-80bb-471d-8cf8-6d4866eb8fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:03.950286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-717494bc-80bb-471d-8cf8-6d4866eb8fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:03.956638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-717494bc-80bb-471d-8cf8-6d4866eb8fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:03.957379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-717494bc-80bb-471d-8cf8-6d4866eb8fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:03.957812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-717494bc-80bb-471d-8cf8-6d4866eb8fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:03.958499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-717494bc-80bb-471d-8cf8-6d4866eb8fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:03.958950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-717494bc-80bb-471d-8cf8-6d4866eb8fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:03.959371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-717494bc-80bb-471d-8cf8-6d4866eb8fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:03.988473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-717494bc-80bb-471d-8cf8-6d4866eb8fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Aug 22 19:41:03.988953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 851/1560] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:05.000618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4755a70c-00bc-4e90-af97-86a202c17280 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:05.002758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4755a70c-00bc-4e90-af97-86a202c17280 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:05.009024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4755a70c-00bc-4e90-af97-86a202c17280 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:05.010002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4755a70c-00bc-4e90-af97-86a202c17280 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:05.010430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4755a70c-00bc-4e90-af97-86a202c17280 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:05.011113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4755a70c-00bc-4e90-af97-86a202c17280 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:05.011557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4755a70c-00bc-4e90-af97-86a202c17280 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:05.011997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4755a70c-00bc-4e90-af97-86a202c17280 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:05.040835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4755a70c-00bc-4e90-af97-86a202c17280 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Aug 22 19:41:05.041373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 710/1561] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:06.052877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7298e2f8-38ec-4a1a-9564-8ebfba1c2ab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:06.055006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7298e2f8-38ec-4a1a-9564-8ebfba1c2ab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:06.061938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7298e2f8-38ec-4a1a-9564-8ebfba1c2ab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:06.062384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7298e2f8-38ec-4a1a-9564-8ebfba1c2ab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:06.062818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7298e2f8-38ec-4a1a-9564-8ebfba1c2ab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:06.063515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7298e2f8-38ec-4a1a-9564-8ebfba1c2ab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:06.063987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7298e2f8-38ec-4a1a-9564-8ebfba1c2ab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:06.064410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7298e2f8-38ec-4a1a-9564-8ebfba1c2ab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:06.093384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7298e2f8-38ec-4a1a-9564-8ebfba1c2ab1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044359 Aug 22 19:41:06.093937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 852/1562] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:07.105800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85c4dc0e-2ee9-47ff-8b72-9cb7b8a78e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:07.107902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85c4dc0e-2ee9-47ff-8b72-9cb7b8a78e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:07.114359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c4dc0e-2ee9-47ff-8b72-9cb7b8a78e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:07.114833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c4dc0e-2ee9-47ff-8b72-9cb7b8a78e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:07.115267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c4dc0e-2ee9-47ff-8b72-9cb7b8a78e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:07.115999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c4dc0e-2ee9-47ff-8b72-9cb7b8a78e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:07.116445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c4dc0e-2ee9-47ff-8b72-9cb7b8a78e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:07.116861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c4dc0e-2ee9-47ff-8b72-9cb7b8a78e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:07.146220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85c4dc0e-2ee9-47ff-8b72-9cb7b8a78e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Aug 22 19:41:07.146998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 711/1563] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:08.158358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b4d7e5d1-30cb-4b86-9fba-2a44a27a32da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:08.160580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b4d7e5d1-30cb-4b86-9fba-2a44a27a32da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:08.166983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4d7e5d1-30cb-4b86-9fba-2a44a27a32da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:08.167402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4d7e5d1-30cb-4b86-9fba-2a44a27a32da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:08.167871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4d7e5d1-30cb-4b86-9fba-2a44a27a32da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:08.168561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4d7e5d1-30cb-4b86-9fba-2a44a27a32da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:08.169010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4d7e5d1-30cb-4b86-9fba-2a44a27a32da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:08.169435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4d7e5d1-30cb-4b86-9fba-2a44a27a32da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:08.199245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b4d7e5d1-30cb-4b86-9fba-2a44a27a32da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Aug 22 19:41:08.199809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 853/1564] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:09.211403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4830257-822e-46eb-b317-e53459913e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:09.214087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4830257-822e-46eb-b317-e53459913e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:09.220394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4830257-822e-46eb-b317-e53459913e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:09.220869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4830257-822e-46eb-b317-e53459913e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:09.221300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4830257-822e-46eb-b317-e53459913e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:09.222067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4830257-822e-46eb-b317-e53459913e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:09.222515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4830257-822e-46eb-b317-e53459913e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:09.222937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4830257-822e-46eb-b317-e53459913e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:09.251545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4830257-822e-46eb-b317-e53459913e43 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Aug 22 19:41:09.252113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 712/1565] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:09 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:10.263696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2f12d638-7f7d-49ff-a457-53831920a8f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:10.266125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2f12d638-7f7d-49ff-a457-53831920a8f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:10.272473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f12d638-7f7d-49ff-a457-53831920a8f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:10.272949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f12d638-7f7d-49ff-a457-53831920a8f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:10.273373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f12d638-7f7d-49ff-a457-53831920a8f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:10.274055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f12d638-7f7d-49ff-a457-53831920a8f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:10.274502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f12d638-7f7d-49ff-a457-53831920a8f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:10.274921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f12d638-7f7d-49ff-a457-53831920a8f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:10.304614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2f12d638-7f7d-49ff-a457-53831920a8f5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Aug 22 19:41:10.305171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 854/1566] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:11.317404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30183977-de2a-4822-9420-350773d1b4e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:11.319503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30183977-de2a-4822-9420-350773d1b4e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:11.325940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30183977-de2a-4822-9420-350773d1b4e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:11.326415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30183977-de2a-4822-9420-350773d1b4e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:11.326847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30183977-de2a-4822-9420-350773d1b4e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:11.327539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30183977-de2a-4822-9420-350773d1b4e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:11.328023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30183977-de2a-4822-9420-350773d1b4e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:11.328446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30183977-de2a-4822-9420-350773d1b4e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:11.358087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30183977-de2a-4822-9420-350773d1b4e2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Aug 22 19:41:11.358625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 713/1567] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:12.370428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f9ffaaad-cc29-4061-9995-51855fead9a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:12.372539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f9ffaaad-cc29-4061-9995-51855fead9a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:12.378792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9ffaaad-cc29-4061-9995-51855fead9a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:12.379266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9ffaaad-cc29-4061-9995-51855fead9a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:12.379724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9ffaaad-cc29-4061-9995-51855fead9a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:12.380412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9ffaaad-cc29-4061-9995-51855fead9a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:12.380858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9ffaaad-cc29-4061-9995-51855fead9a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:12.381279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9ffaaad-cc29-4061-9995-51855fead9a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:12.411669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f9ffaaad-cc29-4061-9995-51855fead9a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Aug 22 19:41:12.412251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 855/1568] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:13.424250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a3bcdb6-fa6e-4118-aaa8-ff24eac53adc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:13.426296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a3bcdb6-fa6e-4118-aaa8-ff24eac53adc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:13.433211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3bcdb6-fa6e-4118-aaa8-ff24eac53adc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:13.433687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3bcdb6-fa6e-4118-aaa8-ff24eac53adc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:13.434122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3bcdb6-fa6e-4118-aaa8-ff24eac53adc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:13.434806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3bcdb6-fa6e-4118-aaa8-ff24eac53adc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:13.435255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3bcdb6-fa6e-4118-aaa8-ff24eac53adc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:13.435758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a3bcdb6-fa6e-4118-aaa8-ff24eac53adc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:13.464861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a3bcdb6-fa6e-4118-aaa8-ff24eac53adc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Aug 22 19:41:13.465392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 714/1569] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:14.010644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:41:14.011236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:41:14.477234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0f452f99-416a-45e1-9082-94bc93ed44cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:14.479967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0f452f99-416a-45e1-9082-94bc93ed44cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:14.486472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f452f99-416a-45e1-9082-94bc93ed44cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:14.486956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f452f99-416a-45e1-9082-94bc93ed44cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:14.487388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f452f99-416a-45e1-9082-94bc93ed44cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:14.488123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f452f99-416a-45e1-9082-94bc93ed44cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:14.488576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f452f99-416a-45e1-9082-94bc93ed44cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:14.489031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f452f99-416a-45e1-9082-94bc93ed44cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:14.517872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0f452f99-416a-45e1-9082-94bc93ed44cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Aug 22 19:41:14.518344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 856/1570] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:15.530777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-901f0ef3-b373-4443-b112-d738170de3ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:15.532981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-901f0ef3-b373-4443-b112-d738170de3ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:15.539391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-901f0ef3-b373-4443-b112-d738170de3ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:15.539921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-901f0ef3-b373-4443-b112-d738170de3ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:15.540364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-901f0ef3-b373-4443-b112-d738170de3ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:15.541063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-901f0ef3-b373-4443-b112-d738170de3ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:15.541547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-901f0ef3-b373-4443-b112-d738170de3ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:15.541975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-901f0ef3-b373-4443-b112-d738170de3ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:15.570201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-901f0ef3-b373-4443-b112-d738170de3ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Aug 22 19:41:15.570747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 715/1571] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:15 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:16.582887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-33ba0bc5-5f77-4020-b0dd-4fc24fec1fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:16.585120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-33ba0bc5-5f77-4020-b0dd-4fc24fec1fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:16.591521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33ba0bc5-5f77-4020-b0dd-4fc24fec1fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:16.592029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33ba0bc5-5f77-4020-b0dd-4fc24fec1fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:16.592460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33ba0bc5-5f77-4020-b0dd-4fc24fec1fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:16.593139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33ba0bc5-5f77-4020-b0dd-4fc24fec1fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:16.593583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33ba0bc5-5f77-4020-b0dd-4fc24fec1fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:16.594001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33ba0bc5-5f77-4020-b0dd-4fc24fec1fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:16.597856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=90 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:16.622965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-33ba0bc5-5f77-4020-b0dd-4fc24fec1fb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Aug 22 19:41:16.623502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 857/1572] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:17.635582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34be371a-694d-4d1e-8c8c-010f2c7c7acb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:17.637735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34be371a-694d-4d1e-8c8c-010f2c7c7acb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:17.644107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34be371a-694d-4d1e-8c8c-010f2c7c7acb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:17.644586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34be371a-694d-4d1e-8c8c-010f2c7c7acb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:17.645020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34be371a-694d-4d1e-8c8c-010f2c7c7acb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:17.645707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34be371a-694d-4d1e-8c8c-010f2c7c7acb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:17.646156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34be371a-694d-4d1e-8c8c-010f2c7c7acb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:17.646578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34be371a-694d-4d1e-8c8c-010f2c7c7acb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:17.675528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34be371a-694d-4d1e-8c8c-010f2c7c7acb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Aug 22 19:41:17.676106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 716/1573] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:18.688137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2005c9c9-3d57-46ac-bf05-ffde24ca8263 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:18.690239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2005c9c9-3d57-46ac-bf05-ffde24ca8263 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:18.696566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2005c9c9-3d57-46ac-bf05-ffde24ca8263 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:18.697612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2005c9c9-3d57-46ac-bf05-ffde24ca8263 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:18.698036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2005c9c9-3d57-46ac-bf05-ffde24ca8263 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:18.698743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2005c9c9-3d57-46ac-bf05-ffde24ca8263 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:18.699192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2005c9c9-3d57-46ac-bf05-ffde24ca8263 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:18.699609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2005c9c9-3d57-46ac-bf05-ffde24ca8263 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:18.729707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2005c9c9-3d57-46ac-bf05-ffde24ca8263 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045383 Aug 22 19:41:18.730257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 858/1574] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:19.741732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65a3d979-241a-4ee1-8ef3-4e4fb371e174 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:19.743836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65a3d979-241a-4ee1-8ef3-4e4fb371e174 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:19.750138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a3d979-241a-4ee1-8ef3-4e4fb371e174 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:19.750613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a3d979-241a-4ee1-8ef3-4e4fb371e174 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:19.751046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a3d979-241a-4ee1-8ef3-4e4fb371e174 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:19.751768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a3d979-241a-4ee1-8ef3-4e4fb371e174 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:19.752221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a3d979-241a-4ee1-8ef3-4e4fb371e174 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:19.752640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65a3d979-241a-4ee1-8ef3-4e4fb371e174 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:19.756170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:19.781260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65a3d979-241a-4ee1-8ef3-4e4fb371e174 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 Aug 22 19:41:19.781802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 717/1575] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:20.793385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f010d947-1850-4e85-8256-e662042a0daf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:20.796015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f010d947-1850-4e85-8256-e662042a0daf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:20.802814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f010d947-1850-4e85-8256-e662042a0daf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:20.803260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f010d947-1850-4e85-8256-e662042a0daf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:20.803972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f010d947-1850-4e85-8256-e662042a0daf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:20.804668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f010d947-1850-4e85-8256-e662042a0daf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:20.805145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f010d947-1850-4e85-8256-e662042a0daf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:20.805565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f010d947-1850-4e85-8256-e662042a0daf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:20.834768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f010d947-1850-4e85-8256-e662042a0daf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Aug 22 19:41:20.835321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 859/1576] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:21.847314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04531676-1a2e-4b37-b572-fa27539d57ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:21.849408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-04531676-1a2e-4b37-b572-fa27539d57ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:21.855981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04531676-1a2e-4b37-b572-fa27539d57ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:21.856460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04531676-1a2e-4b37-b572-fa27539d57ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:21.856895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04531676-1a2e-4b37-b572-fa27539d57ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:21.857582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04531676-1a2e-4b37-b572-fa27539d57ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:21.858031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04531676-1a2e-4b37-b572-fa27539d57ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:21.858453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04531676-1a2e-4b37-b572-fa27539d57ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:21.887311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-04531676-1a2e-4b37-b572-fa27539d57ad tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Aug 22 19:41:21.887864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 718/1577] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:41:22.899627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6cb182f5-a72e-4c86-90c4-8e043d7f82a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:22.902245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6cb182f5-a72e-4c86-90c4-8e043d7f82a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:22.908674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb182f5-a72e-4c86-90c4-8e043d7f82a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:22.909162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb182f5-a72e-4c86-90c4-8e043d7f82a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:22.909595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb182f5-a72e-4c86-90c4-8e043d7f82a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:22.910293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb182f5-a72e-4c86-90c4-8e043d7f82a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:22.910753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb182f5-a72e-4c86-90c4-8e043d7f82a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:22.911168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb182f5-a72e-4c86-90c4-8e043d7f82a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:22.939729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6cb182f5-a72e-4c86-90c4-8e043d7f82a1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Aug 22 19:41:22.940285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 860/1578] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:23.952294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea6db150-4881-4218-9c3c-34526067e0e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:23.954522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea6db150-4881-4218-9c3c-34526067e0e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:23.961701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea6db150-4881-4218-9c3c-34526067e0e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:23.962171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea6db150-4881-4218-9c3c-34526067e0e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:23.962599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea6db150-4881-4218-9c3c-34526067e0e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:23.963282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea6db150-4881-4218-9c3c-34526067e0e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:23.963759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea6db150-4881-4218-9c3c-34526067e0e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:23.964181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea6db150-4881-4218-9c3c-34526067e0e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:23.992928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea6db150-4881-4218-9c3c-34526067e0e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Aug 22 19:41:23.993461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 719/1579] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:25.005487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c096b58d-4b4a-4b31-83ee-a007f39658fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:25.007599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c096b58d-4b4a-4b31-83ee-a007f39658fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:25.009941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=30 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:25.016415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c096b58d-4b4a-4b31-83ee-a007f39658fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:25.016895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c096b58d-4b4a-4b31-83ee-a007f39658fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:25.017327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c096b58d-4b4a-4b31-83ee-a007f39658fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:25.018049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c096b58d-4b4a-4b31-83ee-a007f39658fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:25.018493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c096b58d-4b4a-4b31-83ee-a007f39658fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:25.018968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c096b58d-4b4a-4b31-83ee-a007f39658fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:25.048046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c096b58d-4b4a-4b31-83ee-a007f39658fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 Aug 22 19:41:25.048601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 861/1580] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:26.060750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6dfbe1a1-3502-4160-b21b-3efbce6ee867 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:26.062930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6dfbe1a1-3502-4160-b21b-3efbce6ee867 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:26.065300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:26.070545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dfbe1a1-3502-4160-b21b-3efbce6ee867 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:26.071028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dfbe1a1-3502-4160-b21b-3efbce6ee867 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:26.071466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dfbe1a1-3502-4160-b21b-3efbce6ee867 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:26.072206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dfbe1a1-3502-4160-b21b-3efbce6ee867 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:26.072663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dfbe1a1-3502-4160-b21b-3efbce6ee867 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:26.073089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6dfbe1a1-3502-4160-b21b-3efbce6ee867 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:26.102345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6dfbe1a1-3502-4160-b21b-3efbce6ee867 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Aug 22 19:41:26.102886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 720/1581] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:27.114759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-34dca4d3-2387-40dc-b2d0-3497f37aa659 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:27.116936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-34dca4d3-2387-40dc-b2d0-3497f37aa659 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:27.123425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34dca4d3-2387-40dc-b2d0-3497f37aa659 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:27.123944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34dca4d3-2387-40dc-b2d0-3497f37aa659 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:27.124436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34dca4d3-2387-40dc-b2d0-3497f37aa659 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:27.125075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34dca4d3-2387-40dc-b2d0-3497f37aa659 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:27.125525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34dca4d3-2387-40dc-b2d0-3497f37aa659 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:27.125948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34dca4d3-2387-40dc-b2d0-3497f37aa659 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:27.155476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-34dca4d3-2387-40dc-b2d0-3497f37aa659 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Aug 22 19:41:27.156056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 862/1582] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:27 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:28.167542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2370fcc4-2698-4dc8-885e-3f93e0a7f3da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:28.170314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2370fcc4-2698-4dc8-885e-3f93e0a7f3da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:28.176354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2370fcc4-2698-4dc8-885e-3f93e0a7f3da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:28.176841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2370fcc4-2698-4dc8-885e-3f93e0a7f3da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:28.177270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2370fcc4-2698-4dc8-885e-3f93e0a7f3da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:28.177962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2370fcc4-2698-4dc8-885e-3f93e0a7f3da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:28.178464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2370fcc4-2698-4dc8-885e-3f93e0a7f3da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:28.178889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2370fcc4-2698-4dc8-885e-3f93e0a7f3da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:28.207401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2370fcc4-2698-4dc8-885e-3f93e0a7f3da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Aug 22 19:41:28.207903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 721/1583] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:29.220211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3e1024f8-b28c-4fdf-91e9-463aee49ef05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:29.222388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3e1024f8-b28c-4fdf-91e9-463aee49ef05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:29.228696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1024f8-b28c-4fdf-91e9-463aee49ef05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:29.229175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1024f8-b28c-4fdf-91e9-463aee49ef05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:29.229610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1024f8-b28c-4fdf-91e9-463aee49ef05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:29.230301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1024f8-b28c-4fdf-91e9-463aee49ef05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:29.230747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1024f8-b28c-4fdf-91e9-463aee49ef05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:29.231169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e1024f8-b28c-4fdf-91e9-463aee49ef05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:29.259460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3e1024f8-b28c-4fdf-91e9-463aee49ef05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043183 Aug 22 19:41:29.259961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 863/1584] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:29 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:30.272185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74106f36-fdd3-47f6-b49a-8e437b6eeed0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:30.274312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74106f36-fdd3-47f6-b49a-8e437b6eeed0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:30.280628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74106f36-fdd3-47f6-b49a-8e437b6eeed0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:30.281105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74106f36-fdd3-47f6-b49a-8e437b6eeed0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:30.281534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74106f36-fdd3-47f6-b49a-8e437b6eeed0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:30.282220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74106f36-fdd3-47f6-b49a-8e437b6eeed0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:30.282666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74106f36-fdd3-47f6-b49a-8e437b6eeed0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:30.283084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74106f36-fdd3-47f6-b49a-8e437b6eeed0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:30.312520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74106f36-fdd3-47f6-b49a-8e437b6eeed0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Aug 22 19:41:30.313000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 722/1585] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:31.324420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9f0eae59-079c-46f4-a689-b01d1e23ad7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:31.326575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9f0eae59-079c-46f4-a689-b01d1e23ad7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:31.333133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f0eae59-079c-46f4-a689-b01d1e23ad7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:31.333605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f0eae59-079c-46f4-a689-b01d1e23ad7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:31.334033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f0eae59-079c-46f4-a689-b01d1e23ad7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:31.334716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f0eae59-079c-46f4-a689-b01d1e23ad7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:31.335158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f0eae59-079c-46f4-a689-b01d1e23ad7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:31.335668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f0eae59-079c-46f4-a689-b01d1e23ad7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:31.365280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9f0eae59-079c-46f4-a689-b01d1e23ad7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Aug 22 19:41:31.365850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 864/1586] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:32.377923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d40f9385-7783-4973-ad90-593cc0598e9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:32.380076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d40f9385-7783-4973-ad90-593cc0598e9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:32.387032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40f9385-7783-4973-ad90-593cc0598e9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:32.387521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40f9385-7783-4973-ad90-593cc0598e9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:32.387982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40f9385-7783-4973-ad90-593cc0598e9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:32.388673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40f9385-7783-4973-ad90-593cc0598e9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:32.389128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40f9385-7783-4973-ad90-593cc0598e9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:32.389547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d40f9385-7783-4973-ad90-593cc0598e9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:32.418377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d40f9385-7783-4973-ad90-593cc0598e9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Aug 22 19:41:32.418852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 723/1587] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:33.430988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-46d287f1-17d9-4dbc-93cd-312975846588 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:33.433290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-46d287f1-17d9-4dbc-93cd-312975846588 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:33.439956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46d287f1-17d9-4dbc-93cd-312975846588 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:33.440429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46d287f1-17d9-4dbc-93cd-312975846588 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:33.440857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46d287f1-17d9-4dbc-93cd-312975846588 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:33.441546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46d287f1-17d9-4dbc-93cd-312975846588 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:33.441989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46d287f1-17d9-4dbc-93cd-312975846588 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:33.442405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46d287f1-17d9-4dbc-93cd-312975846588 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:33.472957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-46d287f1-17d9-4dbc-93cd-312975846588 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046379 Aug 22 19:41:33.473510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 865/1588] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:34.484929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c7cba55d-9e90-42c3-af0d-701036a54cf0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:34.487108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c7cba55d-9e90-42c3-af0d-701036a54cf0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:34.493639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7cba55d-9e90-42c3-af0d-701036a54cf0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:34.494122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7cba55d-9e90-42c3-af0d-701036a54cf0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:34.494562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7cba55d-9e90-42c3-af0d-701036a54cf0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:34.495257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7cba55d-9e90-42c3-af0d-701036a54cf0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:34.495753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7cba55d-9e90-42c3-af0d-701036a54cf0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:34.496176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7cba55d-9e90-42c3-af0d-701036a54cf0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:34.525426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c7cba55d-9e90-42c3-af0d-701036a54cf0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Aug 22 19:41:34.525995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 724/1589] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:34 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:41:35.538175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f09f32fd-61c9-4189-877b-f4c2e48d7c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:35.540324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f09f32fd-61c9-4189-877b-f4c2e48d7c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:35.547251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f09f32fd-61c9-4189-877b-f4c2e48d7c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:35.547768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f09f32fd-61c9-4189-877b-f4c2e48d7c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:35.548205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f09f32fd-61c9-4189-877b-f4c2e48d7c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:35.548901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f09f32fd-61c9-4189-877b-f4c2e48d7c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:35.549353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f09f32fd-61c9-4189-877b-f4c2e48d7c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:35.549887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f09f32fd-61c9-4189-877b-f4c2e48d7c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:35.578218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f09f32fd-61c9-4189-877b-f4c2e48d7c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043974 Aug 22 19:41:35.578765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 866/1590] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:36.590646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5abd43f9-0059-4546-9c38-9a7a2a60410e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:36.592805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5abd43f9-0059-4546-9c38-9a7a2a60410e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:36.599099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abd43f9-0059-4546-9c38-9a7a2a60410e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:36.599583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abd43f9-0059-4546-9c38-9a7a2a60410e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:36.600050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abd43f9-0059-4546-9c38-9a7a2a60410e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:36.600750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abd43f9-0059-4546-9c38-9a7a2a60410e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:36.601200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abd43f9-0059-4546-9c38-9a7a2a60410e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:36.601620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5abd43f9-0059-4546-9c38-9a7a2a60410e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:36.631429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5abd43f9-0059-4546-9c38-9a7a2a60410e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045106 Aug 22 19:41:36.631998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 725/1591] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:37.644162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-820a9946-39f6-4454-96dc-f3bc94df19d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:37.646328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-820a9946-39f6-4454-96dc-f3bc94df19d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:37.653650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-820a9946-39f6-4454-96dc-f3bc94df19d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:37.654477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-820a9946-39f6-4454-96dc-f3bc94df19d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:37.655086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-820a9946-39f6-4454-96dc-f3bc94df19d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:37.656720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-820a9946-39f6-4454-96dc-f3bc94df19d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:37.657174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-820a9946-39f6-4454-96dc-f3bc94df19d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:37.657595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-820a9946-39f6-4454-96dc-f3bc94df19d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:37.689935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-820a9946-39f6-4454-96dc-f3bc94df19d5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049917 Aug 22 19:41:37.691028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 867/1592] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:38.703139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ba784ebf-e7c5-4f64-aceb-fa29527449ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:38.705297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ba784ebf-e7c5-4f64-aceb-fa29527449ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:38.711914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba784ebf-e7c5-4f64-aceb-fa29527449ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:38.712396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba784ebf-e7c5-4f64-aceb-fa29527449ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:38.712832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba784ebf-e7c5-4f64-aceb-fa29527449ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:38.713524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba784ebf-e7c5-4f64-aceb-fa29527449ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:38.713977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba784ebf-e7c5-4f64-aceb-fa29527449ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:38.714403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba784ebf-e7c5-4f64-aceb-fa29527449ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:38.744932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ba784ebf-e7c5-4f64-aceb-fa29527449ed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046510 Aug 22 19:41:38.745501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 726/1593] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:39.761099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6eb45e14-88f3-454a-beaf-9ff183d0408d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:39.763213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6eb45e14-88f3-454a-beaf-9ff183d0408d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:39.769579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb45e14-88f3-454a-beaf-9ff183d0408d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:39.770056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb45e14-88f3-454a-beaf-9ff183d0408d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:39.770491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb45e14-88f3-454a-beaf-9ff183d0408d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:39.771177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb45e14-88f3-454a-beaf-9ff183d0408d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:39.771629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb45e14-88f3-454a-beaf-9ff183d0408d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:39.772076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb45e14-88f3-454a-beaf-9ff183d0408d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:39.801842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6eb45e14-88f3-454a-beaf-9ff183d0408d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048199 Aug 22 19:41:39.802589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 868/1594] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:40.813523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48807c6b-553f-4805-894e-23773aa0f438 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:40.815788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48807c6b-553f-4805-894e-23773aa0f438 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:40.822178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48807c6b-553f-4805-894e-23773aa0f438 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:40.822655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48807c6b-553f-4805-894e-23773aa0f438 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:40.823127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48807c6b-553f-4805-894e-23773aa0f438 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:40.823851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48807c6b-553f-4805-894e-23773aa0f438 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:40.824304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48807c6b-553f-4805-894e-23773aa0f438 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:40.825304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48807c6b-553f-4805-894e-23773aa0f438 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:40.855470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48807c6b-553f-4805-894e-23773aa0f438 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046319 Aug 22 19:41:40.856119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 727/1595] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:41.867768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-046c336f-b3c4-4155-979c-447616d02a32 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:41.869981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-046c336f-b3c4-4155-979c-447616d02a32 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:41.877440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046c336f-b3c4-4155-979c-447616d02a32 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:41.878011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046c336f-b3c4-4155-979c-447616d02a32 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:41.878531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046c336f-b3c4-4155-979c-447616d02a32 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:41.879307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046c336f-b3c4-4155-979c-447616d02a32 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:41.879912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046c336f-b3c4-4155-979c-447616d02a32 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:41.880406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046c336f-b3c4-4155-979c-447616d02a32 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:41.909536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-046c336f-b3c4-4155-979c-447616d02a32 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Aug 22 19:41:41.910099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 869/1596] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:42.921535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e26e868-dc67-4e3c-953e-b120848c1590 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:42.923791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5e26e868-dc67-4e3c-953e-b120848c1590 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:42.930779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e26e868-dc67-4e3c-953e-b120848c1590 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:42.931259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e26e868-dc67-4e3c-953e-b120848c1590 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:42.931731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e26e868-dc67-4e3c-953e-b120848c1590 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:42.932403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e26e868-dc67-4e3c-953e-b120848c1590 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:42.932847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e26e868-dc67-4e3c-953e-b120848c1590 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:42.933263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e26e868-dc67-4e3c-953e-b120848c1590 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:42.964215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e26e868-dc67-4e3c-953e-b120848c1590 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046509 Aug 22 19:41:42.964768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 728/1597] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:43.976454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0271d7f9-7e70-423f-9f3f-9fa14fba4d70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:43.978610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0271d7f9-7e70-423f-9f3f-9fa14fba4d70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:43.984915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0271d7f9-7e70-423f-9f3f-9fa14fba4d70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:43.985393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0271d7f9-7e70-423f-9f3f-9fa14fba4d70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:43.985820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0271d7f9-7e70-423f-9f3f-9fa14fba4d70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:43.986511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0271d7f9-7e70-423f-9f3f-9fa14fba4d70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:43.986959 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0271d7f9-7e70-423f-9f3f-9fa14fba4d70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:43.987376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0271d7f9-7e70-423f-9f3f-9fa14fba4d70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:44.018111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0271d7f9-7e70-423f-9f3f-9fa14fba4d70 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Aug 22 19:41:44.018659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 870/1598] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:43 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:44.932868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:41:44.933538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:41:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:41:45.029717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-789ce8fa-f677-4a84-b4a7-da1dad6232d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:45.032652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-789ce8fa-f677-4a84-b4a7-da1dad6232d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:45.039061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-789ce8fa-f677-4a84-b4a7-da1dad6232d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:45.039544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-789ce8fa-f677-4a84-b4a7-da1dad6232d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:45.041327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-789ce8fa-f677-4a84-b4a7-da1dad6232d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:45.041327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-789ce8fa-f677-4a84-b4a7-da1dad6232d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:45.041327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-789ce8fa-f677-4a84-b4a7-da1dad6232d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:45.041712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-789ce8fa-f677-4a84-b4a7-da1dad6232d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:45.070953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-789ce8fa-f677-4a84-b4a7-da1dad6232d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Aug 22 19:41:45.071517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 729/1599] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:46.083063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9de77b75-b4c0-4c66-b7d6-6439f5fb4c97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:46.085239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9de77b75-b4c0-4c66-b7d6-6439f5fb4c97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:46.091806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de77b75-b4c0-4c66-b7d6-6439f5fb4c97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:46.092287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de77b75-b4c0-4c66-b7d6-6439f5fb4c97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:46.092740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de77b75-b4c0-4c66-b7d6-6439f5fb4c97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:46.093461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de77b75-b4c0-4c66-b7d6-6439f5fb4c97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:46.093906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de77b75-b4c0-4c66-b7d6-6439f5fb4c97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:46.094411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de77b75-b4c0-4c66-b7d6-6439f5fb4c97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:46.126442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9de77b75-b4c0-4c66-b7d6-6439f5fb4c97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047416 Aug 22 19:41:46.127017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 871/1600] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:47.138496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96e45197-9261-43df-8400-6a4ad26f25b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:47.141225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96e45197-9261-43df-8400-6a4ad26f25b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:47.148093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e45197-9261-43df-8400-6a4ad26f25b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:47.148580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e45197-9261-43df-8400-6a4ad26f25b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:47.149437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e45197-9261-43df-8400-6a4ad26f25b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:47.149783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e45197-9261-43df-8400-6a4ad26f25b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:47.150232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e45197-9261-43df-8400-6a4ad26f25b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:47.150731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e45197-9261-43df-8400-6a4ad26f25b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:47.180385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96e45197-9261-43df-8400-6a4ad26f25b3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 Aug 22 19:41:47.180941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 730/1601] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:48.192892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-df941c34-4c7c-48b9-9b4d-5ad6df3837fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:48.195020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-df941c34-4c7c-48b9-9b4d-5ad6df3837fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:48.201388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df941c34-4c7c-48b9-9b4d-5ad6df3837fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:48.201868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df941c34-4c7c-48b9-9b4d-5ad6df3837fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:48.202331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df941c34-4c7c-48b9-9b4d-5ad6df3837fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:48.203059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df941c34-4c7c-48b9-9b4d-5ad6df3837fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:48.203511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df941c34-4c7c-48b9-9b4d-5ad6df3837fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:48.203981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-df941c34-4c7c-48b9-9b4d-5ad6df3837fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:48.208001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=90 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:48.235180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-df941c34-4c7c-48b9-9b4d-5ad6df3837fd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Aug 22 19:41:48.235996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 872/1602] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:48.285275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:41:48.285776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:41:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:41:49.247833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48f4b7d5-f727-443e-be87-1cc711a6ab65 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:49.250543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48f4b7d5-f727-443e-be87-1cc711a6ab65 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:49.256971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f4b7d5-f727-443e-be87-1cc711a6ab65 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:49.257467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f4b7d5-f727-443e-be87-1cc711a6ab65 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:49.257901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f4b7d5-f727-443e-be87-1cc711a6ab65 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:49.258627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f4b7d5-f727-443e-be87-1cc711a6ab65 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:49.259082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f4b7d5-f727-443e-be87-1cc711a6ab65 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:49.259511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f4b7d5-f727-443e-be87-1cc711a6ab65 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:49.291459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48f4b7d5-f727-443e-be87-1cc711a6ab65 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047747 Aug 22 19:41:49.292574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 731/1603] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:50.308248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-da2d57f8-bb0b-42c6-8c65-93a25a08cb83 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:50.310359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-da2d57f8-bb0b-42c6-8c65-93a25a08cb83 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:50.316408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da2d57f8-bb0b-42c6-8c65-93a25a08cb83 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:50.316883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da2d57f8-bb0b-42c6-8c65-93a25a08cb83 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:50.317312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da2d57f8-bb0b-42c6-8c65-93a25a08cb83 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:50.317998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da2d57f8-bb0b-42c6-8c65-93a25a08cb83 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:50.318446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da2d57f8-bb0b-42c6-8c65-93a25a08cb83 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:50.318865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da2d57f8-bb0b-42c6-8c65-93a25a08cb83 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:50.349802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-da2d57f8-bb0b-42c6-8c65-93a25a08cb83 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 Aug 22 19:41:50.350367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 873/1604] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:51.362485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17c85d0c-76da-414c-a155-88222b56ccf9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:51.364652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17c85d0c-76da-414c-a155-88222b56ccf9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:51.371144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c85d0c-76da-414c-a155-88222b56ccf9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:51.371631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c85d0c-76da-414c-a155-88222b56ccf9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:51.372102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c85d0c-76da-414c-a155-88222b56ccf9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:51.372832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c85d0c-76da-414c-a155-88222b56ccf9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:51.373270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c85d0c-76da-414c-a155-88222b56ccf9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:51.373696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17c85d0c-76da-414c-a155-88222b56ccf9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:51.376567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:51.407853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17c85d0c-76da-414c-a155-88222b56ccf9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049630 Aug 22 19:41:51.408359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 732/1605] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:52.419931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7dabfbe5-6420-4e89-812f-4ec7fdaa1c72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:52.422106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7dabfbe5-6420-4e89-812f-4ec7fdaa1c72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:52.428437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7dabfbe5-6420-4e89-812f-4ec7fdaa1c72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:52.428913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7dabfbe5-6420-4e89-812f-4ec7fdaa1c72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:52.429348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7dabfbe5-6420-4e89-812f-4ec7fdaa1c72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:52.430036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7dabfbe5-6420-4e89-812f-4ec7fdaa1c72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:52.430499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7dabfbe5-6420-4e89-812f-4ec7fdaa1c72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:52.430946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7dabfbe5-6420-4e89-812f-4ec7fdaa1c72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:52.460494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7dabfbe5-6420-4e89-812f-4ec7fdaa1c72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Aug 22 19:41:52.461035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 874/1606] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:53.476805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b2a7c9d-cfcc-4c92-ac43-528d7fa3faf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:53.476805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b2a7c9d-cfcc-4c92-ac43-528d7fa3faf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:53.481474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c9d-cfcc-4c92-ac43-528d7fa3faf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:53.481953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c9d-cfcc-4c92-ac43-528d7fa3faf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:53.482415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c9d-cfcc-4c92-ac43-528d7fa3faf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:53.483133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c9d-cfcc-4c92-ac43-528d7fa3faf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:53.483585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c9d-cfcc-4c92-ac43-528d7fa3faf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:53.484040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b2a7c9d-cfcc-4c92-ac43-528d7fa3faf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:53.514280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b2a7c9d-cfcc-4c92-ac43-528d7fa3faf1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Aug 22 19:41:53.515363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 733/1607] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:54.535916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0c216030-bef4-4b27-949a-476b5c95f013 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:54.538039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0c216030-bef4-4b27-949a-476b5c95f013 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:54.544364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c216030-bef4-4b27-949a-476b5c95f013 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:54.544844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c216030-bef4-4b27-949a-476b5c95f013 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:54.545274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c216030-bef4-4b27-949a-476b5c95f013 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:54.545957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c216030-bef4-4b27-949a-476b5c95f013 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:54.546406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c216030-bef4-4b27-949a-476b5c95f013 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:54.546827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c216030-bef4-4b27-949a-476b5c95f013 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:54.575532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0c216030-bef4-4b27-949a-476b5c95f013 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Aug 22 19:41:54.576119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 875/1608] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:41:55.589162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92908ba9-5317-46e5-9331-f62247eeaad1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:55.591273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92908ba9-5317-46e5-9331-f62247eeaad1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:55.597617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92908ba9-5317-46e5-9331-f62247eeaad1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:55.598118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92908ba9-5317-46e5-9331-f62247eeaad1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:55.598547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92908ba9-5317-46e5-9331-f62247eeaad1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:55.599224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92908ba9-5317-46e5-9331-f62247eeaad1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:55.599684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92908ba9-5317-46e5-9331-f62247eeaad1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:55.600102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92908ba9-5317-46e5-9331-f62247eeaad1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:55.628166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92908ba9-5317-46e5-9331-f62247eeaad1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 Aug 22 19:41:55.628695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 734/1609] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:56.640340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-94ea68bc-1c0d-49f9-ab4a-7831c3649e6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:56.642485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-94ea68bc-1c0d-49f9-ab4a-7831c3649e6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:56.644799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=30 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:56.649946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ea68bc-1c0d-49f9-ab4a-7831c3649e6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:56.650414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ea68bc-1c0d-49f9-ab4a-7831c3649e6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:56.650860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ea68bc-1c0d-49f9-ab4a-7831c3649e6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:56.651545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ea68bc-1c0d-49f9-ab4a-7831c3649e6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:56.652012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ea68bc-1c0d-49f9-ab4a-7831c3649e6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:56.652425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94ea68bc-1c0d-49f9-ab4a-7831c3649e6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:56.682343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-94ea68bc-1c0d-49f9-ab4a-7831c3649e6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Aug 22 19:41:56.682923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 876/1610] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:57.694280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b2465158-e283-4cc6-a422-b361293fb70f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:57.696500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b2465158-e283-4cc6-a422-b361293fb70f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:57.698782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:57.705224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2465158-e283-4cc6-a422-b361293fb70f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:57.705706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2465158-e283-4cc6-a422-b361293fb70f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:57.706138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2465158-e283-4cc6-a422-b361293fb70f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:57.707084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2465158-e283-4cc6-a422-b361293fb70f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:57.707558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2465158-e283-4cc6-a422-b361293fb70f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:57.708009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2465158-e283-4cc6-a422-b361293fb70f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:57.736979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b2465158-e283-4cc6-a422-b361293fb70f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046307 Aug 22 19:41:57.737933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 735/1611] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:58.750102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-660f7cc2-e4f6-4603-9c20-d6155b22e6dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:58.752332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-660f7cc2-e4f6-4603-9c20-d6155b22e6dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:58.758702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-660f7cc2-e4f6-4603-9c20-d6155b22e6dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:58.759184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-660f7cc2-e4f6-4603-9c20-d6155b22e6dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:58.759619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-660f7cc2-e4f6-4603-9c20-d6155b22e6dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:58.760342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-660f7cc2-e4f6-4603-9c20-d6155b22e6dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:58.760794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-660f7cc2-e4f6-4603-9c20-d6155b22e6dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:58.761215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-660f7cc2-e4f6-4603-9c20-d6155b22e6dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:58.790078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-660f7cc2-e4f6-4603-9c20-d6155b22e6dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Aug 22 19:41:58.790638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 877/1612] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:41:59.802599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-52b787d7-b97f-49eb-bd1d-22b8812b0148 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:41:59.804849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-52b787d7-b97f-49eb-bd1d-22b8812b0148 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:41:59.810775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52b787d7-b97f-49eb-bd1d-22b8812b0148 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:59.811246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52b787d7-b97f-49eb-bd1d-22b8812b0148 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:59.812200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52b787d7-b97f-49eb-bd1d-22b8812b0148 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:59.812892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52b787d7-b97f-49eb-bd1d-22b8812b0148 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:41:59.813340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52b787d7-b97f-49eb-bd1d-22b8812b0148 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:41:59.813758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52b787d7-b97f-49eb-bd1d-22b8812b0148 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:41:59.842390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-52b787d7-b97f-49eb-bd1d-22b8812b0148 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044116 Aug 22 19:41:59.842931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 736/1613] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:41:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:00.854567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5ae6a0ca-5f46-4970-815f-1aa74dbb79c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:00.856772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5ae6a0ca-5f46-4970-815f-1aa74dbb79c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:00.863782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ae6a0ca-5f46-4970-815f-1aa74dbb79c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:00.864264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ae6a0ca-5f46-4970-815f-1aa74dbb79c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:00.864728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ae6a0ca-5f46-4970-815f-1aa74dbb79c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:00.865475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ae6a0ca-5f46-4970-815f-1aa74dbb79c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:00.865848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ae6a0ca-5f46-4970-815f-1aa74dbb79c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:00.866269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ae6a0ca-5f46-4970-815f-1aa74dbb79c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:00.894553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5ae6a0ca-5f46-4970-815f-1aa74dbb79c4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044108 Aug 22 19:42:00.895106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 878/1614] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:01.906288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3329d9cc-044f-4a63-9542-5b8bf72894bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:01.908491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3329d9cc-044f-4a63-9542-5b8bf72894bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:01.914789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3329d9cc-044f-4a63-9542-5b8bf72894bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:01.915263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3329d9cc-044f-4a63-9542-5b8bf72894bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:01.915717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3329d9cc-044f-4a63-9542-5b8bf72894bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:01.916408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3329d9cc-044f-4a63-9542-5b8bf72894bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:01.916861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3329d9cc-044f-4a63-9542-5b8bf72894bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:01.917281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3329d9cc-044f-4a63-9542-5b8bf72894bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:01.947097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3329d9cc-044f-4a63-9542-5b8bf72894bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Aug 22 19:42:01.947568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 737/1615] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:02.958776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2b13e665-bcd1-4edb-92bd-ab90cfd980da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:02.960978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2b13e665-bcd1-4edb-92bd-ab90cfd980da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:02.966859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b13e665-bcd1-4edb-92bd-ab90cfd980da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:02.967334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b13e665-bcd1-4edb-92bd-ab90cfd980da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:02.967799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b13e665-bcd1-4edb-92bd-ab90cfd980da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:02.968497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b13e665-bcd1-4edb-92bd-ab90cfd980da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:02.968943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b13e665-bcd1-4edb-92bd-ab90cfd980da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:02.969369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b13e665-bcd1-4edb-92bd-ab90cfd980da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:02.998796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2b13e665-bcd1-4edb-92bd-ab90cfd980da tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Aug 22 19:42:02.999341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 879/1616] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:04.011476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f00e50c1-879c-467a-aa10-c4753d6a8b2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:04.013646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f00e50c1-879c-467a-aa10-c4753d6a8b2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:04.020212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f00e50c1-879c-467a-aa10-c4753d6a8b2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:04.020700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f00e50c1-879c-467a-aa10-c4753d6a8b2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:04.021185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f00e50c1-879c-467a-aa10-c4753d6a8b2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:04.021893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f00e50c1-879c-467a-aa10-c4753d6a8b2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:04.022367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f00e50c1-879c-467a-aa10-c4753d6a8b2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:04.022785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f00e50c1-879c-467a-aa10-c4753d6a8b2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:04.053006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f00e50c1-879c-467a-aa10-c4753d6a8b2f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045544 Aug 22 19:42:04.053553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 738/1617] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:04.608303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:42:04.608859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:42:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:42:05.065756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5be08861-3fa0-443c-8e75-49bdf5211595 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:05.068132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5be08861-3fa0-443c-8e75-49bdf5211595 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:05.074451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5be08861-3fa0-443c-8e75-49bdf5211595 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:05.074922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5be08861-3fa0-443c-8e75-49bdf5211595 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:05.075460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5be08861-3fa0-443c-8e75-49bdf5211595 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:05.076181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5be08861-3fa0-443c-8e75-49bdf5211595 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:05.076624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5be08861-3fa0-443c-8e75-49bdf5211595 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:05.077040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5be08861-3fa0-443c-8e75-49bdf5211595 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:05.108425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5be08861-3fa0-443c-8e75-49bdf5211595 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046740 Aug 22 19:42:05.113367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 880/1618] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:06.123233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aee9f86a-c31d-4eb7-b353-f6aae4b37d0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:06.125650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aee9f86a-c31d-4eb7-b353-f6aae4b37d0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:06.132647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee9f86a-c31d-4eb7-b353-f6aae4b37d0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:06.133133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee9f86a-c31d-4eb7-b353-f6aae4b37d0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:06.133592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee9f86a-c31d-4eb7-b353-f6aae4b37d0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:06.134291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee9f86a-c31d-4eb7-b353-f6aae4b37d0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:06.134744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee9f86a-c31d-4eb7-b353-f6aae4b37d0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:06.135165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee9f86a-c31d-4eb7-b353-f6aae4b37d0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:06.165304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aee9f86a-c31d-4eb7-b353-f6aae4b37d0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047554 Aug 22 19:42:06.165847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 739/1619] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:07.177174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5a802482-ccf7-47ae-967a-6e732cc56be3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:07.179286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5a802482-ccf7-47ae-967a-6e732cc56be3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:07.185656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a802482-ccf7-47ae-967a-6e732cc56be3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:07.186135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a802482-ccf7-47ae-967a-6e732cc56be3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:07.186569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a802482-ccf7-47ae-967a-6e732cc56be3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:07.187263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a802482-ccf7-47ae-967a-6e732cc56be3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:07.187747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a802482-ccf7-47ae-967a-6e732cc56be3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:07.188170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a802482-ccf7-47ae-967a-6e732cc56be3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:07.219162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5a802482-ccf7-47ae-967a-6e732cc56be3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045860 Aug 22 19:42:07.219897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 881/1620] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:08.232079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-886c771c-b52a-488f-98aa-37312bd799e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:08.234283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-886c771c-b52a-488f-98aa-37312bd799e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:08.240558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-886c771c-b52a-488f-98aa-37312bd799e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:08.241036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-886c771c-b52a-488f-98aa-37312bd799e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:08.241626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-886c771c-b52a-488f-98aa-37312bd799e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:08.242320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-886c771c-b52a-488f-98aa-37312bd799e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:08.242767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-886c771c-b52a-488f-98aa-37312bd799e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:08.243184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-886c771c-b52a-488f-98aa-37312bd799e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:08.273396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-886c771c-b52a-488f-98aa-37312bd799e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Aug 22 19:42:08.273945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 740/1621] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:09.286077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ff2e1f7a-7b1c-462f-b2eb-fda01fff62d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:09.288586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ff2e1f7a-7b1c-462f-b2eb-fda01fff62d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:09.295126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff2e1f7a-7b1c-462f-b2eb-fda01fff62d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:09.295980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff2e1f7a-7b1c-462f-b2eb-fda01fff62d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:09.296092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff2e1f7a-7b1c-462f-b2eb-fda01fff62d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:09.296732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff2e1f7a-7b1c-462f-b2eb-fda01fff62d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:09.297179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff2e1f7a-7b1c-462f-b2eb-fda01fff62d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:09.297596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff2e1f7a-7b1c-462f-b2eb-fda01fff62d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:09.328404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ff2e1f7a-7b1c-462f-b2eb-fda01fff62d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046868 Aug 22 19:42:09.328955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 882/1622] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:09 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:10.340821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b67bc498-4060-40ee-8f73-32860c250a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:10.342958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b67bc498-4060-40ee-8f73-32860c250a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:10.349079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67bc498-4060-40ee-8f73-32860c250a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:10.349556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67bc498-4060-40ee-8f73-32860c250a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:10.349981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67bc498-4060-40ee-8f73-32860c250a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:10.350674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67bc498-4060-40ee-8f73-32860c250a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:10.351120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67bc498-4060-40ee-8f73-32860c250a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:10.351537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b67bc498-4060-40ee-8f73-32860c250a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:10.381690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b67bc498-4060-40ee-8f73-32860c250a54 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 Aug 22 19:42:10.382551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 741/1623] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:11.394376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6080151a-aa66-44a1-ad79-dee3be9161bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:11.396570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6080151a-aa66-44a1-ad79-dee3be9161bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:11.403377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6080151a-aa66-44a1-ad79-dee3be9161bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:11.403907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6080151a-aa66-44a1-ad79-dee3be9161bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:11.404342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6080151a-aa66-44a1-ad79-dee3be9161bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:11.405037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6080151a-aa66-44a1-ad79-dee3be9161bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:11.405485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6080151a-aa66-44a1-ad79-dee3be9161bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:11.405903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6080151a-aa66-44a1-ad79-dee3be9161bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:11.435420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6080151a-aa66-44a1-ad79-dee3be9161bd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Aug 22 19:42:11.435995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 883/1624] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:42:12.448113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e265290-c8e2-4c20-94e2-ccc93cbf2c35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:12.450273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e265290-c8e2-4c20-94e2-ccc93cbf2c35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:12.456619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e265290-c8e2-4c20-94e2-ccc93cbf2c35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:12.457372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e265290-c8e2-4c20-94e2-ccc93cbf2c35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:12.458004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e265290-c8e2-4c20-94e2-ccc93cbf2c35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:12.458495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e265290-c8e2-4c20-94e2-ccc93cbf2c35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:12.458941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e265290-c8e2-4c20-94e2-ccc93cbf2c35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:12.459360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e265290-c8e2-4c20-94e2-ccc93cbf2c35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:12.489481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e265290-c8e2-4c20-94e2-ccc93cbf2c35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Aug 22 19:42:12.490037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 742/1625] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:13.502528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3fd9edd9-9122-417d-8a1b-b797247a558f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:13.504656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3fd9edd9-9122-417d-8a1b-b797247a558f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:13.511371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fd9edd9-9122-417d-8a1b-b797247a558f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:13.511890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fd9edd9-9122-417d-8a1b-b797247a558f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:13.512323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fd9edd9-9122-417d-8a1b-b797247a558f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:13.513014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fd9edd9-9122-417d-8a1b-b797247a558f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:13.513475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fd9edd9-9122-417d-8a1b-b797247a558f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:13.513863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fd9edd9-9122-417d-8a1b-b797247a558f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:13.545707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3fd9edd9-9122-417d-8a1b-b797247a558f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048107 Aug 22 19:42:13.546260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 884/1626] 10.222.0.61 () {58 vars in 1302 bytes} [Mon Aug 22 19:42:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:42:14.557874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-176ff8a5-7971-42d3-ab20-81b108302a2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:42:14.560062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-176ff8a5-7971-42d3-ab20-81b108302a2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:14.566527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176ff8a5-7971-42d3-ab20-81b108302a2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:14.567009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176ff8a5-7971-42d3-ab20-81b108302a2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:14.567430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176ff8a5-7971-42d3-ab20-81b108302a2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:14.568153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176ff8a5-7971-42d3-ab20-81b108302a2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:14.568628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176ff8a5-7971-42d3-ab20-81b108302a2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:14.569045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-176ff8a5-7971-42d3-ab20-81b108302a2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:14.677363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-176ff8a5-7971-42d3-ab20-81b108302a2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "POST /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/action" status: 200 len: 75829 microversion: 2.1 time: 0.123106 Aug 22 19:42:14.678039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 743/1627] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 19:42:14 2022] POST /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc/action => generated 75829 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 19:42:14.799888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:14.800444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:14.806580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:14.807056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:14.807484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:14.808276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:14.808725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:14.809149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:14.835048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Going to try to terminate instance {{(pid=120639) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:42:14.919435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b85b735b-492c-44c7-a6e4-e2655383f670 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 204 len: 0 microversion: 2.1 time: 0.123497 Aug 22 19:42:14.920208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 885/1628] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:42:14 2022] DELETE /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 19:42:14.929568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:14.930268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:14.937193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:14.937672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:14.938106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:14.938795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:14.939245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:14.940249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:15.115979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:15.124225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f077b878-1acd-4495-b1af-715ef58476ff tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.198931 Aug 22 19:42:15.125018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 744/1629] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:14 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:15.804831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-900dadd8-574c-4c03-b8d1-633a72b6519a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] Calling method '.version_select at 0x7f66df1e5a60>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:15.826512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-900dadd8-574c-4c03-b8d1-633a72b6519a tempest-TestVolumeBootPattern-899342940 tempest-TestVolumeBootPattern-899342940-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1088163142" status: 202 len: 0 microversion: 2.1 time: 0.025873 Aug 22 19:42:15.827167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 886/1630] 10.222.0.61 () {58 vars in 1263 bytes} [Mon Aug 22 19:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1088163142 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:42:16.146736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:16.147851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:16.153799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:16.154284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:16.154725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:16.155424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:16.155909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:16.156335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:16.287683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:16.295798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45788b21-1822-4796-8a77-d19b343c0671 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153555 Aug 22 19:42:16.296371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 745/1631] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:16 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:16.958266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:16.959021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:16.965659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:16.966369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:16.966804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:16.967504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:16.967980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:16.968403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:16.996201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Going to try to terminate instance {{(pid=120639) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:42:17.011754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:17.017407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:17.018819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:17.025729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:17.026670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:17.027115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:17.027855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:17.028345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:17.028867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:17.056376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:42:17.084751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d7fafa4e-51ac-472c-bcbe-600699d99f4e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 204 len: 0 microversion: 2.1 time: 0.130306 Aug 22 19:42:17.085735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 887/1632] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:42:16 2022] DELETE /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:42:17.096719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:17.097634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:17.103713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:17.104188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:17.104723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:17.105313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:17.105780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:17.106148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:17.168263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b2b36fbd-4a84-4c0a-83e1-0ca198405e45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 204 len: 0 microversion: 2.1 time: 0.154432 Aug 22 19:42:17.169937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 746/1633] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:42:17 2022] DELETE /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:42:17.178474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:17.179254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:17.185194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:17.185674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:17.186108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:17.186813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:17.187261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:17.187708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:17.209800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:17.330501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:17.339003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b55f6454-c6ae-4789-8b73-c0670c787b80 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.164895 Aug 22 19:42:17.339958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 747/1634] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:17.344975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:17.346076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:17.358523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:17.359340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:17.359830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:17.360614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:17.361081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:17.362292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:17.420951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:17.431310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-075e035a-f69b-4d54-ae4d-a3c851c257d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.339727 Aug 22 19:42:17.432605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 888/1635] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:17.505490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:17.514017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c2c7292-7523-4bfa-9a0a-60cfd85b4e7d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.172874 Aug 22 19:42:17.514579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 748/1636] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:17 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:18.360164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:18.360827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:18.372789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:18.373332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:18.373964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:18.374887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:18.375392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:18.376024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:18.453475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:18.454698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:18.464186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:18.464704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:18.465138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:18.465841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:18.466281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:18.466733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:18.607356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:18.616239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12ed6a31-f33e-4122-88cf-25766aef0a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.166583 Aug 22 19:42:18.616814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 749/1637] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:18.621673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:18.622751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:18.630298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:18.630797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:18.631239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:18.631970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:18.632434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:18.632860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:18.661303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:18.673052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-771fa298-8859-409f-8ff7-f090a183093a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.316952 Aug 22 19:42:18.678210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 889/1638] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:18 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:18.767941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:18.776762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef36efba-571d-441f-a368-8b3c7b52ea2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.158742 Aug 22 19:42:18.777334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 750/1639] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:18 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:19.639493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:19.640143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:19.651226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:19.652125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:19.652751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:19.653631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:19.654079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:19.654507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:19.701906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:19.703365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:19.712337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:19.713005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:19.713632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:19.714512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:19.715120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:19.715909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:19.872828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:19.881892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9cf30c00-a997-4aa2-84cd-f57838c130e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.183897 Aug 22 19:42:19.882470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 751/1640] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:19 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:19.888507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:19.889281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:19.897377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:19.897950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:19.898460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:19.899240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:19.899817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:19.900304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:20.050585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:20.059683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8aac6ff-ae4e-4e3f-b1c0-cb7177d553d3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.175196 Aug 22 19:42:20.060343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 752/1641] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:19 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:20.150157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:20.158210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d485d14c-562c-4487-869b-23dff70260fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.523535 Aug 22 19:42:20.159487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 890/1642] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:19 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:20.903751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:20.904376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:20.911203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:20.912038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:20.912609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:20.913440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:20.913988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:20.914602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:21.052714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:21.061850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5c8d002-4221-4ef0-b6ed-d4240514e958 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.161914 Aug 22 19:42:21.062518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 753/1643] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:20 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:21.080755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:21.081300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:21.088004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:21.088494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:21.088928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:21.089626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:21.090073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:21.090497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:21.180839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:21.181443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:21.187254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:21.187756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:21.188191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:21.189040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:21.189554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:21.190025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:21.281172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:21.290004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-70c7cc7f-5411-4f0b-ac33-feb7f7a861a0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.213083 Aug 22 19:42:21.290920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 891/1644] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:21 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:21.322396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:21.330705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12602114-52d6-49ec-ae96-580c87e7ec74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153667 Aug 22 19:42:21.331352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 754/1645] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:22.084842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:22.085743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:22.092328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:22.092805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:22.093236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:22.093927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:22.094371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:22.094784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:22.253497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:22.262368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3395b01c-4280-497a-9b2b-adcc2c41a5a5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.182248 Aug 22 19:42:22.262951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 892/1646] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:22 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:22.311196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:22.311924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:22.319721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:22.320234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:22.320946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:22.321464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:22.321866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:22.322283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:22.352240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:22.353052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:22.359047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:22.359596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:22.360120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:22.360882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:22.361941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:22.362429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:22.501021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:22.509735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a8e66471-0269-46cc-a410-88150b4d545f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.161266 Aug 22 19:42:22.510303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 893/1647] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:22.561913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:22.577253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93f609f0-58bc-4037-a1d6-be5d569cd522 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.269672 Aug 22 19:42:22.577917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 755/1648] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:22 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:23.284967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:23.285611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:23.291702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:23.292173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:23.292597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:23.293282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:23.293725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:23.294146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:23.433490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:23.451610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f228da01-28ca-4ad8-ba94-05640717683a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.171154 Aug 22 19:42:23.452221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 894/1649] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:23 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:23.532075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:23.532689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:23.539191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:23.539699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:23.540137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:23.540837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:23.541294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:23.541728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:23.598400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:23.599085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:23.606025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:23.606517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:23.607013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:23.607737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:23.608385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:23.608940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:23.683116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:23.693280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d530c98-e163-471d-8f5a-6b3a68d94e64 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.165166 Aug 22 19:42:23.694539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 756/1650] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:23.774490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:23.786761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0bfb09cf-72a2-4c8e-8557-7b2f0a37bdb7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.191595 Aug 22 19:42:23.788239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 895/1651] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:23 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:24.474390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:24.474999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:24.480876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:24.481346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:24.481772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:24.482452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:24.482895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:24.483306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:24.612775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:24.620848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86461fe4-6750-4114-90d5-c180833f9ffb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150852 Aug 22 19:42:24.621405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 757/1652] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:24 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:24.716359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:24.716987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:24.724589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:24.725002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:24.725434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:24.726120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:24.726563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:24.726978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:24.809185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:24.809788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:24.815929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:24.816412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:24.816841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:24.817531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:24.817980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:24.818397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:24.862079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:24.870470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2e81dad7-888d-4f08-b5f5-a9597f919acf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.157886 Aug 22 19:42:24.871037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 896/1653] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:24.948326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:24.956996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41b6c15c-6e37-41d5-9462-741de2a5e6b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151638 Aug 22 19:42:24.957814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 758/1654] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:24 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:25.641894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:25.642502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:25.648944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:25.649423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:25.649858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:25.650544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:25.650990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:25.651410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:25.778243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:25.786314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6822b15f-1fff-42cb-809a-fc4976759fa5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148247 Aug 22 19:42:25.786873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 897/1655] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:25 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:25.891676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:25.892340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:25.899269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:25.899784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:25.900224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:25.900913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:25.901370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:25.901802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:25.978406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:25.979020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:25.985024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:25.985512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:25.985946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:25.986641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:25.987091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:25.987505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:26.034413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:26.042575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-181d0c86-ef8b-4f12-8870-bd4a4c9b41b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154765 Aug 22 19:42:26.043437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 759/1656] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:25 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:26.117994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:26.126181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-af3413a3-3a44-4399-b7e4-d5714800bd80 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151663 Aug 22 19:42:26.126743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 898/1657] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:25 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:26.806487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:26.807127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:26.813228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:26.813714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:26.814151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:26.814849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:26.815294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:26.815744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:26.942696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:26.950699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-856f1751-2044-46fe-988f-30df27c8b7c2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148077 Aug 22 19:42:26.951279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 760/1658] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:26 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:27.064935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:27.065475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:27.068004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:27.073240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:27.073716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:27.074147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:27.074828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:27.075271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:27.075712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:27.148238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:27.148975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:27.155082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:27.155568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:27.156048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:27.156758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:27.157209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:27.157632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:27.206659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:27.215266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8c8a4642-abcc-4c95-b2f7-da8d17e3e7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154302 Aug 22 19:42:27.215881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 899/1659] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:27.294493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:27.302463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70f0addb-c66b-4ee0-a2d0-1308091f7e52 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.158193 Aug 22 19:42:27.303017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 761/1660] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:27 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:27.973227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:27.973757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:27.979678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:27.980142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:27.980567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:27.981246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:27.981688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:27.982102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:28.107067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:28.115245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-396f067f-34b1-4156-a5c1-ecdb78a9e592 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146366 Aug 22 19:42:28.115853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 900/1661] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:27 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:28.236805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:28.237408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:28.239672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:28.244996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:28.245485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:28.245934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:28.246632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:28.247087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:28.247512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:28.323684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:28.324425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:28.330648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:28.331126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:28.331556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:28.332276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:28.332981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:28.333396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:28.381611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:28.391293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-802f1c6f-2330-40b8-8aaf-abda430374c1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.158277 Aug 22 19:42:28.391674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 762/1662] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:28.468239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:28.477011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8f572b6b-5fc1-4b1f-8a8e-0b028a2fe7e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.157130 Aug 22 19:42:28.477589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 901/1663] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:28 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:29.136689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:29.137293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:29.143535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:29.144043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:29.144473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:29.145166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:29.145608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:29.146022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:29.273491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:29.281937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-addf007c-8b2a-43cf-afbc-3b9c54fa043a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149152 Aug 22 19:42:29.282509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 763/1664] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:29 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:29.413664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:29.414216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:29.420602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:29.421082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:29.421512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:29.422197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:29.422646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:29.423065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:29.498346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:29.498967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:29.505073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:29.505593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:29.506033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:29.506764 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:29.507221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:29.507668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:29.511622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:29.553101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:29.561211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b831957d-a832-4731-ac21-f182204c0fde tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151443 Aug 22 19:42:29.561791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 902/1665] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:29.640672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:29.648684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b137878e-1927-41ea-b0d8-07744697692b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154254 Aug 22 19:42:29.649241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 764/1666] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:29 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:30.304011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:30.304621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:30.310588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:30.311065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:30.311493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:30.312203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:30.312651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:30.313072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:30.315563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:30.442545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:30.450663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-233dde95-a7fc-40ef-8d28-da1abdac564b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150587 Aug 22 19:42:30.451228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 903/1667] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:30 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:30.582964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:30.583575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:30.589954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:30.590433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:30.590870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:30.591561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:30.592039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:30.592460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:30.670072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:30.671101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:30.677275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:30.677756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:30.678191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:30.678881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:30.679327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:30.679779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:30.720784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:30.729583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5be974a1-00c8-4f3d-a3a2-e51ec7ca4774 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151109 Aug 22 19:42:30.730149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 765/1668] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:30 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:30.807610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:30.817368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-95de3f4f-68ff-4c22-802c-884403085b9e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151324 Aug 22 19:42:30.817933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 904/1669] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:30 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:31.472627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:31.473231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:31.479241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:31.479754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:31.480186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:31.480870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:31.481315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:31.481733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:31.611483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:31.619517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5233228-f40f-4079-8e1b-76dedb606dbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151454 Aug 22 19:42:31.620099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 766/1670] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:31 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:31.750201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:31.750753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:31.757413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:31.757888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:31.758321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:31.759005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:31.759452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:31.759898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:31.839768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:31.840384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:31.846356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:31.846838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:31.847269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:31.847992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:31.848639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:31.849191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:31.894083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:31.903045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-97b4266d-6528-4f4f-b6e2-70fcb44953b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.156681 Aug 22 19:42:31.903623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 905/1671] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:31.978482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:31.986782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d842bd1d-bd72-45b1-b4f2-38335ee52bf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151080 Aug 22 19:42:31.987346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 767/1672] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:31 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:32.641090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:32.641752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:32.648274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:32.648746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:32.649174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:32.649854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:32.650295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:32.650711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:32.781174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:32.789273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8639f8a5-502e-4488-b257-fd8f7f36f3e8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152411 Aug 22 19:42:32.789829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 906/1673] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:32 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:32.923781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:32.924870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:32.931200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:32.931703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:32.932135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:32.932816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:32.933259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:32.933690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:33.008526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:33.009263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:33.015448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:33.015969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:33.016407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:33.017098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:33.017622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:33.018083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:33.065792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:33.074632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-61b59022-f670-4b48-93f7-55168b8dafe0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154707 Aug 22 19:42:33.075212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 768/1674] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:33.146876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:33.154952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2a04f64c-5206-43e7-8bf9-21f6ea3993bb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150338 Aug 22 19:42:33.155512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 907/1675] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:33 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:33.810630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:33.811376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:33.817466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:33.817949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:33.818382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:33.819077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:33.819526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:33.819972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:33.960755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:33.968942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b55c0de7-e359-4223-84e3-98972489bf02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.162265 Aug 22 19:42:33.969505 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 769/1676] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:33 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:34.096287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:34.096833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:34.103169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:34.103670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:34.104119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:34.104812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:34.105265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:34.105688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:34.176116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:34.176725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:34.182530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:34.183006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:34.183436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:34.184155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:34.184601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:34.185021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:34.238757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:34.246880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-19aa1bea-f676-475a-a0fb-19f24a381c6f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154457 Aug 22 19:42:34.247450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 908/1677] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:34.314100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:34.322803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6819d813-aefe-408d-bb7c-98d85d8b539e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150583 Aug 22 19:42:34.323361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 770/1678] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:34 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:34.990144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:34.990688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:35.000199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:35.000693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:35.001126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:35.001808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:35.002251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:35.003204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:35.130809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:35.139199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-81d7f1ae-ed6f-4f13-9467-7eef99032b15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152915 Aug 22 19:42:35.139795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 909/1679] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:34 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:35.268985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:35.269525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:35.276237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:35.276718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:35.277177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:35.277862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:35.278308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:35.278728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:35.343732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:35.344378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:35.350232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:35.350709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:35.351139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:35.351850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:35.352297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:35.352714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:35.409988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:35.418174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10e217c4-188a-43cf-951a-e25329cd9a1d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153096 Aug 22 19:42:35.418742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 771/1680] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:35.483403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:35.492177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d098dc06-b6de-4c71-b5b1-a658b781d850 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152220 Aug 22 19:42:35.492744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 910/1681] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:35 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:36.161001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:36.161609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:36.167477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:36.167986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:36.168420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:36.169098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:36.169543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:36.169960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:36.295286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:36.303304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5aed53b2-bdbf-4271-be88-82d61920aa66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146763 Aug 22 19:42:36.303896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 772/1682] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:36 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:36.440734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:36.441343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:36.447713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:36.448189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:36.448626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:36.449296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:36.449737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:36.450153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:36.513646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:36.514258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:36.520759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:36.521239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:36.521671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:36.522365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:36.522813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:36.523234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:36.579397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:36.587883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4913ce39-b012-46ee-89ec-34f285dfaef7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151441 Aug 22 19:42:36.588689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 911/1683] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:36.650179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:36.658267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a104f928-7493-4ca9-a905-8ee9b39ad272 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148476 Aug 22 19:42:36.658847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 773/1684] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:36 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:37.325034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:37.325643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:37.331570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:37.332073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:37.332506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:37.333448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:37.333898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:37.334319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:37.460093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:37.468236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a24f397a-49d6-42be-b1ee-fb4ec2ba78be tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147189 Aug 22 19:42:37.468801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 912/1685] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:37 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:37.609082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:37.609717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:37.617049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:37.617523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:37.617954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:37.618667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:37.619113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:37.619526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:37.679218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:37.679870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:37.685833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:37.686329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:37.686754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:37.687445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:37.687985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:37.688417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:37.753229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:37.761583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83ac7bfe-d4c5-487b-a05f-05dd24fad489 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.156251 Aug 22 19:42:37.762162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 774/1686] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:37 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:37.822662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:37.830704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0b1b173f-d84c-4d75-8670-be9801a3aeae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.156219 Aug 22 19:42:37.831263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 913/1687] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:37 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:38.489708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:38.490318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:38.496767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:38.497470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:38.497914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:38.498632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:38.499080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:38.499502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:38.769583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:38.778043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab4f49c2-78e7-4b98-8d9d-63b9b86c7ea5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.292087 Aug 22 19:42:38.788456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 775/1688] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:38 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:38.794491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:38.795626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:38.806452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:38.807325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:38.807965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:38.808669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:38.809122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:38.809542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:38.852068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:38.852979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:38.858930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:38.859406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:38.859867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:38.860567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:38.861023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:38.861440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:38.942230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:38.952121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6148c1a4-f1f9-496b-989f-3ef5c6d0aeaa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.172988 Aug 22 19:42:38.953029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 914/1689] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:39.078801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:39.089720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4a94ccc-b257-42e0-8247-73b5eeaa2363 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.241535 Aug 22 19:42:39.090375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 776/1690] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:38 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:39.799984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:39.800596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:39.807000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:39.807479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:39.807943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:39.808632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:39.809082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:39.809504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:39.938742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:39.946897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-af35c6de-3026-44b4-be60-024a1cc8bcdb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151328 Aug 22 19:42:39.947475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 915/1691] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:39 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:39.974749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:39.975290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:39.981655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:39.982130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:39.982558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:39.983240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:39.983709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:39.984131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:40.114173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:40.120997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:40.121618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:40.124607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96e1a942-c8b8-4bf4-8b3a-ff839053eb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154077 Aug 22 19:42:40.125232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 777/1692] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:40.127737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:40.128225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:40.128658 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:40.129357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:40.129806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:40.130227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:40.260276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:40.269088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d1941868-7647-43e9-9139-192f95f3bef5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152707 Aug 22 19:42:40.269569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 916/1693] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:40 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:40.968296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:40.968904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:40.974873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:40.975536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:40.975808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:40.976503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:40.976954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:40.977375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:41.110080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:41.119921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-291d049d-5d6d-4673-8e6b-7baa6c046f43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155427 Aug 22 19:42:41.120485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 778/1694] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:40 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:41.145902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:41.146665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:41.153016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:41.153489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:41.153916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:41.154596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:41.155039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:41.155454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:41.287400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:41.289921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:41.290537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:41.295717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eeddf500-83d5-447a-b56c-a71bc4321e13 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153551 Aug 22 19:42:41.296312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:41.296484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 917/1695] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:41 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:41.296789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:41.297220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:41.297910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:41.298356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:41.298774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:41.427586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:41.435652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-151a74fa-cffd-43c1-a304-3b04621881f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149766 Aug 22 19:42:41.436227 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 779/1696] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:41 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:42.141581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:42.142228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:42.148338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:42.148892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:42.149227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:42.149956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:42.150399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:42.150815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:42.282728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:42.291455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6ae75c30-6611-48b7-b340-194eb2ddb48a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153799 Aug 22 19:42:42.292039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 918/1697] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:42.317525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:42.318131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:42.324537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:42.325014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:42.325444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:42.326641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:42.327090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:42.327514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:42.456603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:42.457256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:42.458909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:42.461149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:42.463687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:42.464174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:42.464607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:42.465306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:42.465764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:42.466188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:42.468832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-486c3f54-f6ba-47b7-a127-84c04eaca193 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.155127 Aug 22 19:42:42.469398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 780/1698] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:42.592314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:42.594466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:42.602412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a9c25aed-9c94-424f-8f93-9611ce76a9ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149685 Aug 22 19:42:42.602978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 919/1699] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:42 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:43.314504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:43.315872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:43.322476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:43.323056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:43.323399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:43.324130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:43.324587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:43.325019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:43.452554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:43.460971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ba36f653-89dd-4e26-b922-c797f2f54380 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150686 Aug 22 19:42:43.461532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 781/1700] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:43 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:43.490855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:43.491605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:43.499069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:43.499622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:43.500265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:43.501440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:43.501909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:43.502339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:43.623206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:43.624079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:43.630696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:43.631179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:43.631613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:43.632302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:43.632449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:43.632769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:43.633189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:43.640754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ce411f74-f630-438b-8dd1-d11da31b6c4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154283 Aug 22 19:42:43.641349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 920/1701] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:43 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:43.761799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:43.770033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47133423-4f3d-4aaa-81e5-a776851b98e9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150741 Aug 22 19:42:43.770597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 782/1702] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:43 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:44.482244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:44.482960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:44.490110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:44.490588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:44.491014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:44.491786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:44.492238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:44.492652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:44.622097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:44.630867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f7b3654f-68b6-4832-a177-7e3a6612329c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152493 Aug 22 19:42:44.631436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 921/1703] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:44 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:44.663398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:44.664312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:44.670763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:44.671237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:44.672365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:44.673066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:44.673511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:44.673987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:44.791093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:44.791679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:44.797972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:44.798453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:44.798886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:44.799671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:44.800127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:44.801056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:44.813902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:44.823246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1beee7f3-c7a6-4f73-b6ac-a7887b806e5c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.164892 Aug 22 19:42:44.824046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 783/1704] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:44 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:45.156612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:45.165472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-833869c1-0b30-4a28-a9ec-52c570ca6686 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.378632 Aug 22 19:42:45.166054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 922/1705] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:44 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:45.667732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:45.668301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:45.675192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:45.675689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:45.676125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:45.676804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:45.677253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:45.677670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:45.805846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:45.814105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-280f3098-e616-4958-a853-474bf551b6f1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150340 Aug 22 19:42:45.814930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 784/1706] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:45 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:45.845645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:45.846273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:45.852273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:45.852754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:45.853194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:45.853881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:45.854333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:45.854757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:45.982025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:45.991084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6cb4b529-a002-47a4-aed1-f986620a1ce1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149216 Aug 22 19:42:45.992010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 923/1707] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:45 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:46.186944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:46.187469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:46.193775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:46.194275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:46.194710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:46.195518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:46.195995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:46.196418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:46.329546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:46.338438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa7e761c-2854-4bca-b0f5-391d7092ea34 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.155621 Aug 22 19:42:46.338996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 785/1708] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:46 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:46.836874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:46.837398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:46.843399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:46.843906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:46.844339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:46.845019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:46.845468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:46.845887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:46.973378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:46.981452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b5836612-ee64-4d31-9972-90e37ac0a17f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149381 Aug 22 19:42:46.982043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 924/1709] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:46 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:47.012283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:47.012894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:47.019188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:47.019741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:47.020177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:47.020899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:47.021350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:47.021772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:47.150245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:47.158292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9d89d54-1402-456b-9f48-380b6b2029ae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149802 Aug 22 19:42:47.158851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 786/1710] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:47 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:47.360231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:47.360755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:47.367334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:47.367843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:47.368274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:47.368953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:47.369396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:47.369815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:47.500277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:47.508539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5da38b30-98cd-4c90-a9c9-95d0b3234413 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152272 Aug 22 19:42:47.509101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 925/1711] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:47 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:48.003151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:48.003703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:48.009617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:48.010156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:48.010596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:48.011318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:48.011804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:48.012228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:48.143357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:48.152296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b71d66f8-5388-449e-9041-d91e198ace05 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153050 Aug 22 19:42:48.152856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 787/1712] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:47 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:48.179674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:48.180290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:48.186578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:48.187050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:48.187481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:48.188189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:48.188643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:48.189056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:48.473412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:48.482036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a7c3d33f-71f7-4eac-9619-b5130d42e935 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.306005 Aug 22 19:42:48.482995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 926/1713] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:48 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:48.528755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:48.529364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:48.535200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:48.535699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:48.536134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:48.536817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:48.537264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:48.537680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:48.665787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:48.673984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d31d8ad-20f8-4869-ad51-4e14b9e5a57c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148964 Aug 22 19:42:48.674510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 788/1714] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:48 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:49.173627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:49.174237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:49.180824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:49.181394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:49.181725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:49.182417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:49.182864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:49.183284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:49.315713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:49.323856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d85a153c-16fb-4f99-92d6-4b41b25014a6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154090 Aug 22 19:42:49.324403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 927/1715] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:49 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:49.504492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:49.505107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:49.511601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:49.512115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:49.512578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:49.513268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:49.513718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:49.514141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:49.645524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:49.655049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-774cf7ba-7bf2-45e0-bd6d-a6891d41cf80 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154434 Aug 22 19:42:49.655618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 789/1716] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:49 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:49.694609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:49.695219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:49.701098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:49.701575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:49.702009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:49.702697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:49.703147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:49.703564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:49.828626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:49.837767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9ed24282-50c2-43ee-8429-4e8cd91c805e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147402 Aug 22 19:42:49.838324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 928/1717] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:49 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:50.345717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:50.346348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:50.353012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:50.353521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:50.353961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:50.354646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:50.355096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:50.355516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:50.485679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:50.494026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-198cdccf-7525-495c-a713-6fc255fad983 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152176 Aug 22 19:42:50.494583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 790/1718] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:50 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:42:50.675445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:50.676173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:50.682597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:50.683078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:50.683515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:50.684231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:50.684731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:50.685104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:50.822385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:50.830819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0816b8e8-0c83-474b-ae11-5025e89d4943 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.159246 Aug 22 19:42:50.831382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 929/1719] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:50 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:50.858256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:50.859055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:50.866106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:50.866584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:50.867010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:50.867730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:50.868180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:50.868598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:50.999159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:51.007960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6e42515-cee7-4196-bb60-f5c7c07c7063 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153516 Aug 22 19:42:51.008522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 791/1720] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:50 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:51.516096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:51.516708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:51.523306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:51.523810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:51.524244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:51.524929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:51.525382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:51.525804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:51.652002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:51.660007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-85c64185-6099-4abf-b4b6-e77a595a9715 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147769 Aug 22 19:42:51.661240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 930/1721] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:51 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:51.852656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:51.853261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:51.859528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:51.860157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:51.860452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:51.861134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:51.861580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:51.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:51.995447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:52.003741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05d425c3-ae9e-4b4a-8e30-7ea3a55e9bdd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154748 Aug 22 19:42:52.004337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 792/1722] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:51 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:52.028900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:52.029485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:52.036352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:52.036828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:52.037304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:52.037991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:52.038440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:52.038862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:52.167088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:52.175301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e6362ee1-3669-4a42-856c-5637c84be4db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150249 Aug 22 19:42:52.176475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 931/1723] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:52 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:52.681877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:52.682476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:52.688792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:52.689327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:52.689755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:52.690994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:52.691946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:52.692373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:52.822479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:52.830623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a54c44ea-32d5-4e9f-8a29-d6ba8960deca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152603 Aug 22 19:42:52.831191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 793/1724] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:52 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:53.024724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:53.025340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:53.031858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:53.032733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:53.032733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:53.033449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:53.033898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:53.034322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:53.166941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:53.175142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-14762ce5-657f-4363-b26a-5460537ae320 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154262 Aug 22 19:42:53.176238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 932/1725] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:53 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:53.197272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:53.198047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:53.204400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:53.204889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:53.205328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:53.206031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:53.206481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:53.206915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:53.335155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:53.343436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a11b724a-caa8-48cc-b948-0b4b57187f9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149897 Aug 22 19:42:53.344039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 794/1726] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:53 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:53.852633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:53.853237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:53.859485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:53.860015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:53.860458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:53.861192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:53.861738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:53.862165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:53.989310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:53.997739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5fcc97bc-ecbc-48b5-9f42-6b8a3dcae13a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148929 Aug 22 19:42:53.998293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 933/1727] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:53 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:54.197290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:54.197895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:54.204004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:54.204480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:54.204912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:54.205590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:54.206034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:54.206447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:54.337545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:54.345600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a49a0668-9abf-4f91-9dad-99b4e0902402 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152180 Aug 22 19:42:54.346158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 795/1728] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:54 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:54.366502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:54.367115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:54.373448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:54.373924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:54.374358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:54.375075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:54.375536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:54.375972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:54.505919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:54.514034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ed354107-bcbf-476e-9cb8-c0597698b32c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151863 Aug 22 19:42:54.514596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 934/1729] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:54 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:55.020443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:55.021445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:55.027546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:55.028063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:55.028491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:55.029175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:55.029624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:55.030041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:55.160688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:55.169018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8894646-bad5-43d3-921a-0d1b8da4540e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153237 Aug 22 19:42:55.169586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 796/1730] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:55 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:55.367764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:55.368307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:55.374986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:55.375469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:55.376480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:55.377187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:55.377642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:55.378064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:55.503732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:55.512502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c7687fde-b3b8-484a-808d-4c37de0dd0fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148757 Aug 22 19:42:55.513062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 935/1731] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:55 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:55.534128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:55.534739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:55.541058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:55.541562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:55.541993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:55.542676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:55.543120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:55.543535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:55.558586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:55.674019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:55.682756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c6e13bd-51f7-497b-af3a-01c5d5904f7f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152392 Aug 22 19:42:55.683328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 797/1732] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:55 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:56.190459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:56.191083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:56.198058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:56.198541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:56.198973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:56.199683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:56.200125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:56.200543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:56.216863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:56.329618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:56.338475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e2330ea3-e393-40ee-9c58-db0adcc45e29 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151925 Aug 22 19:42:56.339047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 936/1733] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:56 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:56.532557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:56.533163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:56.539511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:56.540132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:56.540455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:56.541109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:56.541638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:56.542056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:56.668546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:56.677454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22b082f8-6bbc-45b0-876a-034d191d8a37 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148721 Aug 22 19:42:56.678017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 798/1734] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:56 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:56.703578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:56.704213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:56.710805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:56.711275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:56.711729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:56.712408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:56.712887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:56.713303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:56.841304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:56.850029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a8a67fb5-14fa-4259-ab04-cc07e1bf0e1e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150281 Aug 22 19:42:56.850594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 937/1735] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:56 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:57.360351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:57.360870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:57.366827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:57.367305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:57.367758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:57.368439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:57.368887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:57.369324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:57.501385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:57.510141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35f676dd-db54-49dd-bced-451506fad00b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153782 Aug 22 19:42:57.510707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 799/1736] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:57 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:57.698704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:57.699368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:57.701256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=78 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:57.706487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:57.707083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:57.707532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:57.708514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:57.708966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:57.709389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:57.836658 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:57.844680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-56379228-d2c0-4892-90d5-17865f02b03a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149870 Aug 22 19:42:57.845236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 938/1737] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:57 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:57.870979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:57.871620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:57.878103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:57.878583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:57.879738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:57.880362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:57.880813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:57.881239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:58.010943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:58.019457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c69c34b8-85bc-4d23-92ff-eee16d3a239d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152544 Aug 22 19:42:58.020046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 800/1738] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:57 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:58.531249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:58.531995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:58.537886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:58.538355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:58.538784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:58.539459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:58.539930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:58.540347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:58.668767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:58.676808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c94831e7-cd3a-4ba4-ac95-7e57b029b569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149451 Aug 22 19:42:58.677942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 939/1739] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:58 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:58.866865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:58.867392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:58.869282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=78 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:58.874799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:58.875406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:58.875719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:58.876406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:58.876859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:58.877280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:59.003855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:59.011814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7068a00-8e75-4b03-8263-cf22b57b4838 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149697 Aug 22 19:42:59.012383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 801/1740] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:58 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:59.042311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:59.042311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:59.047762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:59.048250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:59.048680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:59.049365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:59.049812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:59.050226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:59.181340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:59.189673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-85206c6c-7596-4e91-a9f8-04f5cc9f692c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153101 Aug 22 19:42:59.190231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 940/1741] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:59 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:42:59.698567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:42:59.699179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:42:59.705182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:59.705665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:59.706101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:59.706789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:42:59.707237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:42:59.707679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:42:59.838625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:42:59.846692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f448eeb5-bb4a-45c3-8e03-6a665f991481 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152017 Aug 22 19:42:59.847245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 802/1742] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:42:59 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:00.033449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:00.034045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:00.040022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:00.040507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:00.040944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:00.041636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:00.042088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:00.042514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:00.174586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:00.183380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f9998ddb-6c5b-43df-83e5-83c15dcdaad2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153820 Aug 22 19:43:00.183996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 941/1743] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:00 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:00.210372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:00.210980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:00.217496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:00.217991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:00.218428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:00.219125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:00.219580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:00.220029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:00.348579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:00.357211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a24c292-92b6-4379-aa48-9add5f52c537 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150846 Aug 22 19:43:00.357775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 803/1744] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:00 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:00.868155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:00.868772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:00.874647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:00.875130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:00.875568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:00.876320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:00.876774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:00.877206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:01.001745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:01.010355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-33a83f2c-24fb-49c3-a183-d2ad99bd91e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146105 Aug 22 19:43:01.010912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 942/1745] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:00 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:01.204384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:01.205021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:01.211184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:01.211820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:01.212100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:01.212809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:01.213252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:01.213669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:01.347431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:01.355594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-247da02c-dc33-491d-8446-e6d302c03391 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.155045 Aug 22 19:43:01.356175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 804/1746] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:01 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:01.378401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:01.379095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:01.385816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:01.386293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:01.386718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:01.387406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:01.387912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:01.388333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:01.514467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:01.522750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8c05bf77-45c9-4965-b489-0cb7a4a6c9f9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148337 Aug 22 19:43:01.523311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 943/1747] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:01 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:02.033419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:02.033952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:02.040623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:02.041106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:02.041546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:02.042242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:02.042701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:02.043127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:02.176200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:02.184290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b79e6d92-f350-4749-b14d-7e6fe2bb1c1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154844 Aug 22 19:43:02.184850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 805/1748] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:02 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:02.377296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:02.377907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:02.385092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:02.385708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:02.386026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:02.386719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:02.387167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:02.387589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:02.515739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:02.524571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dd47043b-b861-4050-8fc7-8c2e8a2bcb2f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151150 Aug 22 19:43:02.525135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 944/1749] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:02 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:02.543456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:02.544100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:02.550432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:02.550909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:02.551340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:02.552045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:02.552492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:02.552940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:02.679569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:02.687703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0bc3d24-ad4a-464e-96c2-b299f23377cc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148066 Aug 22 19:43:02.688288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 806/1750] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:02 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:03.205661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:03.206266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:03.212429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:03.212888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:03.213314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:03.213993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:03.214440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:03.214858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:03.349357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:03.357971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3fec1a00-a78d-45e6-9394-cb3da9727b43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156180 Aug 22 19:43:03.358529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 945/1751] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:03 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:03.545902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:03.546518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:03.553012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:03.553453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:03.553888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:03.554577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:03.555029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:03.555451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:03.685816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:03.694372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5921c1fb-6df9-48d5-af44-ce3259af618c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152425 Aug 22 19:43:03.694942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 807/1752] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:03 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:03.710028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:03.710666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:03.716960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:03.717433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:03.717889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:03.718572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:03.719013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:03.719484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:03.849015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:03.857188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5ef1f23e-d666-4a05-b63e-8ca64aeb1f21 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151999 Aug 22 19:43:03.857744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 946/1753] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:03 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:04.379855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:04.380496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:04.387095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:04.387579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:04.388054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:04.388749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:04.389204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:04.389629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:04.517480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:04.525593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42198866-5ae8-47a1-afbe-e15a91470719 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149634 Aug 22 19:43:04.526150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 808/1754] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:04 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:04.717916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:04.718528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:04.725551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:04.726026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:04.726458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:04.727140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:04.727587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:04.728050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:04.855318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:04.863453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-649d0e8f-b8e0-48e2-8aec-cdc666a081c0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149400 Aug 22 19:43:04.864035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 947/1755] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:04 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:04.877309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:04.877930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:04.884391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:04.884873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:04.885311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:04.886008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:04.886461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:04.886916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:05.015891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:05.024493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-772c17d9-e524-40ba-8faf-c25e1019da8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151013 Aug 22 19:43:05.025060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 809/1756] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:04 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:05.546207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:05.546744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:05.552664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:05.553142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:05.553569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:05.554249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:05.554691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:05.555113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:05.684728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:05.692747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d8bdb090-0e18-47c4-9ecb-145d1af282f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150412 Aug 22 19:43:05.693308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 948/1757] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:05 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:05.886000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:05.886613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:05.893168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:05.893646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:05.894082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:05.894768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:05.895221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:05.895659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:06.023252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:06.031335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb6ade81-21fe-4adc-b924-06986b30ae04 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150095 Aug 22 19:43:06.031926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 810/1758] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:05 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:06.045582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:06.046188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:06.053201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:06.053617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:06.054043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:06.054723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:06.055164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:06.055585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:06.180844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:06.189301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0de68f98-589a-4058-913e-96143dd85ae9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147496 Aug 22 19:43:06.189862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 949/1759] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:06 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:06.714756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:06.715286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:06.721258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:06.721737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:06.722172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:06.722865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:06.723311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:06.723761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:06.856079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:06.864261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a949db66-622a-44bc-ac69-658861573696 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153525 Aug 22 19:43:06.864829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 811/1760] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:06 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:07.053842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:07.054891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:07.060994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:07.061475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:07.061907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:07.062598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:07.063049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:07.063466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:07.190587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:07.198641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e0488745-41e4-4015-b4b2-069b0ed27686 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149805 Aug 22 19:43:07.199199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 950/1761] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:07 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:07.211019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:07.211761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:07.218333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:07.218815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:07.219254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:07.219983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:07.220436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:07.220860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:07.351098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:07.359190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d294266-b2df-4449-b8cb-13d26971a188 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152827 Aug 22 19:43:07.359771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 812/1762] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:07 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:07.886275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:07.886902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:07.892996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:07.893471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:07.893899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:07.894577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:07.895019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:07.895436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:08.025328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:08.033496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c762a5b8-e134-4afa-815e-eb83ebb92c5f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151127 Aug 22 19:43:08.034072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 951/1763] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:07 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:08.220458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:08.221072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:08.228153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:08.228631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:08.229065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:08.229752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:08.230203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:08.230626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:08.356601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:08.364819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0ebd8ca-8363-4ded-a738-953579c59a54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148154 Aug 22 19:43:08.365387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 813/1764] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:08 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:08.382143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:08.382756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:08.389204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:08.389675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:08.390104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:08.390791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:08.391241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:08.391690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:08.519280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:08.528141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4f276bcc-e49c-4213-bedb-bf62a79b95ae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150325 Aug 22 19:43:08.528714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 952/1765] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:08 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:09.055878 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:09.056482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:09.062409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:09.062883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:09.063313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:09.064019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:09.064465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:09.064880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:09.067367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:09.198424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:09.206542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3c57ba8-f405-4ac9-82ef-e633b731011f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155201 Aug 22 19:43:09.207110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 814/1766] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:09 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:09.386497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:09.387074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:09.393651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:09.394125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:09.394551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:09.395235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:09.395698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:09.396117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:09.398684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:09.527408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:09.536378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bfc12e66-1e6d-4380-b021-37da2443352e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153300 Aug 22 19:43:09.537120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 953/1767] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:09 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:09.548182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:09.548797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:09.555245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:09.555758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:09.556191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:09.556869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:09.557315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:09.557967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:09.687594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:09.696427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8462ce24-3949-4c2d-89d0-501a07ea727c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151784 Aug 22 19:43:09.696954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 815/1768] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:09 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:10.228078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:10.228687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:10.234587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:10.235061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:10.235491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:10.236306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:10.236759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:10.237180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:10.361562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:10.370110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b16487a9-fe81-4c8a-9913-d3948b77d207 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146600 Aug 22 19:43:10.370672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 954/1769] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:10 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:10.558659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:10.559414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:10.565908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:10.566382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:10.566808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:10.567492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:10.567969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:10.568386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:10.701838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:10.710200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5d78d561-246b-422d-ab2e-d8217dba1105 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.155724 Aug 22 19:43:10.710750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 816/1770] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:10 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:10.717921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:10.718539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:10.725457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:10.725970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:10.726413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:10.727300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:10.727783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:10.728206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:10.857689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:10.866313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-87c69c3e-6961-44ee-9f94-06ef12db6e31 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151641 Aug 22 19:43:10.866876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 955/1771] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:10 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:11.391613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:11.392248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:11.398873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:11.399292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:11.399758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:11.400454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:11.400902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:11.401323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:11.530802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:11.539020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2520846e-3d17-44d4-8d20-61c593ccbf9a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151393 Aug 22 19:43:11.539587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 817/1772] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:11 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:11.732687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:11.733304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:11.739968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:11.741227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:11.741670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:11.742373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:11.742826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:11.743250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:11.874901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:11.883557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e2e12fe1-04e7-499a-bf57-94cdcfd2915e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.155134 Aug 22 19:43:11.884142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 956/1773] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:11 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:11.886859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:11.887479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:11.893892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:11.894375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:11.894814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:11.895508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:11.896055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:11.896483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:12.024244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:12.032336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d8bc11b-9f71-4ad3-9e77-6a08af8a218c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149284 Aug 22 19:43:12.032890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 818/1774] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:11 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:12.559523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:12.560157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:12.566125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:12.566599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:12.567031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:12.567795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:12.568250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:12.568686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:12.696418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:12.704922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-52f0bf2d-8ab9-4dcd-aec7-8c87a1ee29cc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149222 Aug 22 19:43:12.705481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 957/1775] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:12 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:12.904953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:12.905656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:12.912085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:12.912590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:12.913018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:12.913708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:12.914156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:12.914576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:13.045181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:13.053751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0940b1f-a35f-4c12-84b3-f489ca5049a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152559 Aug 22 19:43:13.053955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:13.054427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 819/1776] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:12 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:13.054559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:13.062367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:13.062932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:13.063375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:13.064109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:13.064567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:13.065000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:13.200315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:13.208697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fcca3c0e-5dc1-4143-aac8-0435336d0cbe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.158675 Aug 22 19:43:13.209807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 958/1777] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:13 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:13.727071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:13.727719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:13.733758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:13.734245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:13.734691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:13.735387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:13.735876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:13.736302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:13.865339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:13.873886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-233c4c42-df90-4dce-9ffb-b546d9429a0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150735 Aug 22 19:43:13.874448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 820/1778] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:14.075990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:14.076556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:14.082934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:14.083712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:14.084702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:14.085723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:14.085854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:14.086264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:14.216070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:14.224344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b37d7dca-ba36-4783-b5b3-b1e15ddb3ea6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152409 Aug 22 19:43:14.225578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 959/1779] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:14.230253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:14.230865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:14.237488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:14.237964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:14.238398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:14.239080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:14.239526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:14.240045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:14.373712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:14.382287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0913c29-6c8e-41e7-ab98-7290432c307f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.156010 Aug 22 19:43:14.382843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 821/1780] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:14 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:14.894906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:14.895548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:14.901406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:14.901882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:14.902320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:14.903002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:14.903448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:14.903907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:15.035025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:15.043589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e8962de3-71db-40e3-aeef-e59eaeb917c6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152525 Aug 22 19:43:15.044177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 960/1781] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:15.246313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:15.246905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:15.253952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:15.254440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:15.254869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:15.255556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:15.256031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:15.256448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:15.391236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:15.400251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a86438de-d483-4e4b-8cd1-362c08668aba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.157671 Aug 22 19:43:15.400748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 822/1782] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:15.403942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:15.404555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:15.410633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:15.411096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:15.411532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:15.412245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:15.412692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:15.413114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:15.541915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:15.549999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a279f045-f85b-42bb-90fd-cfca141aae97 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149938 Aug 22 19:43:15.550565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 961/1783] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:15 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:16.065331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:16.066120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:16.072737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:16.073236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:16.073670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:16.074368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:16.074824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:16.075277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:16.209023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:16.217679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a050a36e-d711-4045-a5e4-7ccadb863382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156348 Aug 22 19:43:16.218243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 823/1784] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:16 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:16.422004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:16.422588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:16.428948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:16.429471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:16.429920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:16.430612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:16.431064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:16.431489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:16.560522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:16.568637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c7009674-2a19-47d0-8ef9-73c220cc85ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150582 Aug 22 19:43:16.569206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 962/1785] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:16.572242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:16.572849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:16.579060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:16.579530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:16.580000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:16.580689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:16.581130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:16.581546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:16.708758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:16.717425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35cad84e-af61-47df-9dfb-4169868fd7e3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149472 Aug 22 19:43:16.717983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 824/1786] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:16 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:17.239553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:17.240310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:17.246892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:17.247302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:17.247768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:17.248451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:17.248896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:17.249316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:17.383201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:17.391387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a6ece6c0-9c1e-43e7-919d-688152ba1452 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155920 Aug 22 19:43:17.391988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 963/1787] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:17.591025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:17.591605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:17.598023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:17.598506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:17.598944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:17.599691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:17.600147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:17.600571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:17.728271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:17.736657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-544f3220-f36a-4e0e-adf4-07fad4bc34db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149465 Aug 22 19:43:17.737226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 825/1788] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:17.738283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:17.738901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:17.745815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:17.746289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:17.746721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:17.747411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:17.747920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:17.748370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:17.876867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:17.885712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c73ed92e-29ee-4eff-b289-7706a5307a77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151385 Aug 22 19:43:17.886273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 964/1789] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:17 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:18.412627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:18.413164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:18.419221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:18.419727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:18.420191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:18.420876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:18.421321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:18.421737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:18.553232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:18.562967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2ba9b83b-91b8-4828-9f19-cb3fa348f084 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154231 Aug 22 19:43:18.563542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 826/1790] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:18 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:18.758965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:18.759574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:18.765976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:18.766445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:18.766875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:18.767553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:18.768024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:18.768445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:18.897700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:18.906010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fadd5755-8b40-4ae0-9c6b-8e4ac6d3079e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151518 Aug 22 19:43:18.906396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:18.906871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 965/1791] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:18.907014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:18.913317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:18.914348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:18.914777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:18.915465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:18.915942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:18.916508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:19.045758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:19.053874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-56aa5ad7-f9db-4969-8903-a52a841354aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151315 Aug 22 19:43:19.055072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 827/1792] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:18 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:19.584092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:19.584645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:19.590671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:19.591149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:19.591583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:19.592300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:19.592750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:19.593171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:19.718751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:19.727546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-63c71c1d-5f82-43ff-a398-8923a61da06f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147708 Aug 22 19:43:19.728212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 966/1793] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:19 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:19.927888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:19.928487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:19.935010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:19.935480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:19.935952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:19.936635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:19.937080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:19.937499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:20.066821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:20.075368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:20.075935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6be5d17-8617-4d8f-b514-eb4162b6e8dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151408 Aug 22 19:43:20.076057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 828/1794] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:19 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:20.076148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:20.082403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:20.082882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:20.083580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:20.084299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:20.084746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:20.085168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:20.215408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:20.223634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9fc30392-3afb-46fd-937f-48e7f78ebf0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152050 Aug 22 19:43:20.224224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 967/1795] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:20 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:20.748388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:20.749023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:20.755306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:20.755831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:20.756276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:20.756966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:20.757419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:20.757847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:20.888315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:20.896590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9e7d3f5-7d09-411f-b7a7-780bb80d30cf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152051 Aug 22 19:43:20.897183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 829/1796] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:20 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:21.097547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:21.098100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:21.104464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:21.104937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:21.105366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:21.106045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:21.106488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:21.106906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:21.237144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:21.246111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-934b51b7-ae3f-4fd9-b416-8cc320689a4d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152417 Aug 22 19:43:21.246687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 968/1797] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:21.247410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:21.248729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:21.255096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:21.255667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:21.256049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:21.256746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:21.257228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:21.257651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:21.386005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:21.388202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:21.395845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7cc5b8f9-6068-4b31-a8e4-8554188f5990 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153307 Aug 22 19:43:21.396418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 830/1798] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:21 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:21.918209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:21.918898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:21.925039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:21.925520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:21.925957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:21.926645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:21.927096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:21.927514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:22.051821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:22.053997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:22.061739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fe273e8a-9ee9-41e6-9c5a-144cf41b9310 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147409 Aug 22 19:43:22.062501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 969/1799] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:21 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:22.268135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:22.268679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:22.275700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:22.276204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:22.276869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:22.277309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:22.277751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:22.278167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:22.411259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:22.418094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:22.418742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:22.421871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c083ee2c-097d-4528-ad06-3b2eff0606b9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.157579 Aug 22 19:43:22.422450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 831/1800] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:22.425528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:22.426121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:22.426612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:22.427332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:22.428018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:22.428555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:22.574166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:22.582248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-728cba00-d973-43de-8352-5eec57eecf6b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.168662 Aug 22 19:43:22.582815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 970/1801] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:22 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:23.082888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:23.083788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:23.090212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:23.090695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:23.091131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:23.091854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:23.092306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:23.092726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:23.222280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:23.231091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2948f5fd-c070-4fed-8161-997852dc8d6d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152196 Aug 22 19:43:23.231729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 832/1802] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:23 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:23.459841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:23.461012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:23.469417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:23.469948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:23.470532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:23.471246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:23.471785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:23.472213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:23.600752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:23.604032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:23.604653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:23.609412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9b525091-08f0-427b-ae74-ed3685c3a4d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154140 Aug 22 19:43:23.609993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 971/1803] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:23.610996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:23.611509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:23.611983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:23.612683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:23.613134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:23.613556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:23.746011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:23.754352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-366e35ad-1ef1-4892-8a2d-dd3ecc8b43fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154075 Aug 22 19:43:23.754958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 833/1804] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:23 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:24.252031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:24.252996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:24.259817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:24.260295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:24.260723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:24.261399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:24.261843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:24.262256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:24.391597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:24.400936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f8715aed-10bf-43c0-bd79-e6418377aa0b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152795 Aug 22 19:43:24.401444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 972/1805] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:24 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:24.630378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:24.630998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:24.637591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:24.638069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:24.638498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:24.639184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:24.639627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:24.640204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:24.768814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:24.776618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:24.777227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:24.777807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e92e9a1-e1e7-44d7-8d87-2505231d97b7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151295 Aug 22 19:43:24.778377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 834/1806] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:24.783795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:24.784277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:24.784706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:24.785394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:24.785961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:24.786387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:24.914280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:24.922751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7662405c-630e-480b-8da0-15e5e5f603d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150704 Aug 22 19:43:24.923327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 973/1807] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:24 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:25.422492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:25.423034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:25.429220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:25.429701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:25.430135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:25.430826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:25.431301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:25.431743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:25.566244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:25.574830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9cb1acaf-8db4-4bc2-a6dc-8a9bd745c1ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156644 Aug 22 19:43:25.575591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 835/1808] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:25 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:25.799530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:25.800162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:25.806566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:25.807044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:25.807476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:25.808180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:25.808626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:25.809045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:25.935437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:25.943754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f7421405-3c98-4b33-bf2b-727ec9aecc9a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148075 Aug 22 19:43:25.944228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:25.944709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 974/1809] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:25 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:25.944847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:25.951856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:25.952342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:25.952780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:25.953477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:25.953930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:25.954351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:26.083323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:26.091669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84076aa5-8b43-45ce-82d8-21c6f46e22fc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151263 Aug 22 19:43:26.092232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 836/1810] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:25 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:26.596594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:26.597210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:26.603722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:26.604206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:26.604640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:26.605339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:26.605791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:26.606217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:26.739060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:26.747100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fb44635f-d706-41b4-a952-95aac33f0f18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154418 Aug 22 19:43:26.747679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 975/1811] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:26 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:26.966153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:26.966773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:26.973142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:26.973622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:26.974059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:26.974747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:26.975198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:26.975619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:27.102077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:27.112508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6250c2ee-1166-44ce-907d-d957c1649f54 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148547 Aug 22 19:43:27.112508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 837/1812] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:26 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:27.113026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:27.113791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:27.121142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:27.121695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:27.122127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:27.122824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:27.123269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:27.123718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:27.248197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:43:27.248426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:43:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde (ip 10.222.0.61) !!! Aug 22 19:43:27.252332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:27.263460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6c292eeb-c3e6-4422-b763-149fa3b4d773 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154614 Aug 22 19:43:27.264424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 976/1813] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:27 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:27.767709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:27.768323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:27.775326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:27.775919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:27.776353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:27.777129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:27.777605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:27.778023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:27.910430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:27.918669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c6791ae-b862-4148-8069-551b04df63e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154914 Aug 22 19:43:27.919242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 838/1814] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:27 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:28.132031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:28.132590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:28.135546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=78 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:28.140763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:28.141242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:28.141675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:28.142370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:28.142814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:28.143236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:28.272276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:28.280371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-83257c7a-cc92-441b-a419-529f02f20929 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152328 Aug 22 19:43:28.280934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 977/1815] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:28.286292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:28.286907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:28.293369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:28.293842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:28.294285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:28.295552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:28.296401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:28.296906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:28.427854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:28.436921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9e240f6-ccc5-406f-9a40-b9652c274220 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.155284 Aug 22 19:43:28.437511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 839/1816] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:28 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:28.939882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:28.940491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:28.947281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:28.947781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:28.948216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:28.948902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:28.949348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:28.949766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:29.074838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:29.082877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6b2dd734-8d67-4c78-ac90-67d4fc2fbbd1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146904 Aug 22 19:43:29.083775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 978/1817] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:28 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:29.301769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:29.302332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:29.304514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=78 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:29.309593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:29.310086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:29.310526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:29.311309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:29.311843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:29.312296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:29.443791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:29.452603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7efeb35a-7ec3-48fa-bca8-34d46eb011b3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154935 Aug 22 19:43:29.453175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 840/1818] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:29.460474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:29.461092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:29.468014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:29.468496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:29.468929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:29.469621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:29.470066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:29.470491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:29.595810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:29.604006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-17006306-eb8a-4d25-8243-2b0ceabb3a17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147574 Aug 22 19:43:29.604577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 979/1819] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:29 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:30.104829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:30.105437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:30.111354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:30.111880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:30.112314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:30.113004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:30.113448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:30.113868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:30.238695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:30.246829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a139dcdd-8bed-4fc6-972b-811e63ee2ad6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.145926 Aug 22 19:43:30.247404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 841/1820] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:30 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:30.474643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:30.475245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:30.482551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:30.483024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:30.483459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:30.484171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:30.484614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:30.485031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:30.613495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:30.621897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2ed6aca9-dd88-48ff-b521-a1d9040b77c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151034 Aug 22 19:43:30.622466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 980/1821] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:30 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:30.623757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:30.624377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:30.630941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:30.631231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:30.631687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:30.632383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:30.632834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:30.633256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:30.764094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:30.772344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dae26525-c171-4126-bc14-bb22ce9f825e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152390 Aug 22 19:43:30.772903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 842/1822] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:30 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:31.268667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:31.269273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:31.275320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:31.275856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:31.276293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:31.276974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:31.277420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:31.277843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:31.401938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:31.410239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-febe5746-d251-41cb-8943-560a6355476e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.145500 Aug 22 19:43:31.410807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 981/1823] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:31 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:31.643473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:31.644098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:31.651281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:31.651736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:31.652170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:31.652863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:31.653314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:31.653738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:31.783852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:31.792452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb8699de-0241-47c1-9e02-efb8f10a3bab tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152977 Aug 22 19:43:31.793195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 843/1824] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:31.795824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:31.796439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:31.802592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:31.803461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:31.804113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:31.804735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:31.805182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:31.805675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:31.939667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:31.948033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f68adb7c-0a4f-413e-a83a-b6edd8b5faa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.158290 Aug 22 19:43:31.948597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 982/1825] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:31 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:32.431303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:32.431982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:32.438123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:32.438598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:32.439026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:32.439744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:32.440191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:32.440607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:32.566084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:32.574771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb0fef34-f436-491b-abd7-906deb6e0807 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147386 Aug 22 19:43:32.575330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 844/1826] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:32 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:32.814591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:32.815203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:32.822234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:32.822721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:32.823137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:32.823924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:32.824371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:32.824794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:32.951366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:32.960707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9420ee09-666b-4243-a4f2-f47c81d1c8ed tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150073 Aug 22 19:43:32.961282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 983/1827] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:32.969035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:32.969649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:32.976255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:32.976738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:32.977171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:32.978426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:32.978874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:32.979294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:33.111365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:33.119590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d531ba2-5bdc-4791-9da9-dbdfe62cc469 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154337 Aug 22 19:43:33.120179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 845/1828] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:32 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:33.597041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:33.597652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:33.604383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:33.604856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:33.605320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:33.606005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:33.606453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:33.606871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:33.732047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:33.740276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0ce74cb9-82bf-4f06-a6e8-7ba90b4ff0f8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147181 Aug 22 19:43:33.740838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 984/1829] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:33 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:33.982043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:33.982691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:33.989834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:33.990320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:33.990758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:33.991454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:33.991933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:33.992359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:34.124030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:34.132462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f5ad69e-7fe1-4c2a-96f7-9e2b36654009 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154483 Aug 22 19:43:34.133031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 846/1830] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:33 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:34.141183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:34.142036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:34.148448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:34.148942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:34.149450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:34.150152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:34.150605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:34.151030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:34.277038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:34.285341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a3b463f3-000e-4f11-b8f4-d8c20a36ce62 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148072 Aug 22 19:43:34.285907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 985/1831] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:34 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:34.761410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:34.762022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:34.768249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:34.768725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:34.769157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:34.769842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:34.770286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:34.770706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:34.785360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:34.903101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:34.911323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d93b2d22-90b6-4f1d-b6c0-7f6c7928c98b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153872 Aug 22 19:43:34.911935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 847/1832] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:34 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:35.154689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:35.155304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:35.161696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:35.162178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:35.162611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:35.163294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:35.163775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:35.164199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:35.180740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:35.292937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:35.301090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-78bed7af-b696-4a1a-b9f8-9d74ae795e87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150199 Aug 22 19:43:35.301655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 986/1833] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:35.305237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:35.306453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:35.312461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:35.312940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:35.313376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:35.314058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:35.314506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:35.314924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:35.441402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:35.449972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e1e8130-9da3-4e4d-a465-088556e03aee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148442 Aug 22 19:43:35.450549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 848/1834] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:35 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:35.933640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:35.934249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:35.940223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:35.940704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:35.941142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:35.941828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:35.942276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:35.942696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:36.072062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:36.080074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9ec78179-091e-48ac-9dd7-8be1f8e9cec2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150813 Aug 22 19:43:36.080633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 987/1835] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:35 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:36.323944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:36.324483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:36.330955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:36.331436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:36.331906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:36.332596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:36.333049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:36.333472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:36.461614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:36.469757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d64f0851-650f-4444-8467-55445448a116 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150288 Aug 22 19:43:36.470321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 849/1836] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:36.471814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:36.472430 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:36.478727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:36.479200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:36.479635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:36.480340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:36.480783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:36.481200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:36.605163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:36.613166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a3e51b84-eaec-41f5-a94c-d60ce715e13b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.145384 Aug 22 19:43:36.613757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 988/1837] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:36 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:37.101619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:37.102235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:37.108120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:37.108603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:37.109040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:37.109738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:37.110192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:37.110618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:37.246282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:37.254329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2896756a-762e-4a9a-a6cc-449232c33d55 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156474 Aug 22 19:43:37.254889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 850/1838] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:37 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:37.491016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:37.491631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:37.498076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:37.498555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:37.498985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:37.499701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:37.500150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:37.500571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:37.628440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:37.634718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:37.635326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:37.637270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9efa831f-db0c-469b-a1e3-13c2f1a67759 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150090 Aug 22 19:43:37.637844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 989/1839] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:37 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:37.641692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:37.642167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:37.642602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:37.643320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:37.643797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:37.644215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:37.770844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:37.779560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1124e61e-ae36-4cf6-8848-680c6a4944dc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149101 Aug 22 19:43:37.780202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 851/1840] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:37 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:38.276680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:38.277301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:38.283214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:38.283732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:38.284169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:38.284859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:38.285309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:38.285734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:38.414768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:38.423097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b0d3255e-68cb-40be-bd8c-798129687beb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150821 Aug 22 19:43:38.423705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 990/1841] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:38 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:38.658982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:38.659635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:38.666269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:38.666690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:38.667116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:38.667831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:38.668280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:38.668700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:38.800287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:38.800906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:38.801548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:38.809301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:38.809503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08fc2445-71a7-4054-94b7-ad321801c078 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153816 Aug 22 19:43:38.809620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:38.809843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:38.810481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:38.810942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:38.811368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:38.820078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 852/1842] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:38.937158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:38.945244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1d75f9ef-2078-4ac6-b81b-e662f37c0248 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148169 Aug 22 19:43:38.945815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 991/1843] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:38 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:39.444408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:39.445022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:39.450883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:39.451307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:39.451770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:39.452453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:39.452895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:39.453308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:39.579952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:39.588931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cfd4d32-8e16-458b-9804-69d67e7fa855 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148358 Aug 22 19:43:39.589498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 853/1844] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:39 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:39.831011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:39.831724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:39.838419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:39.838900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:39.839338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:39.840056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:39.840511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:39.840938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:39.966507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:39.966985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:39.968871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:39.973350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:39.973854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:39.974273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:39.974975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:39.975425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:39.975879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:39.976942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e8ae3951-6e82-484c-bdbf-dc633cba9089 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149877 Aug 22 19:43:39.978060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 992/1845] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:40.101236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:40.109298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a991a69-671c-48ed-aaa8-3639fc776571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146834 Aug 22 19:43:40.109858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 854/1846] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:39 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:40.609607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:40.610165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:40.616087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:40.616560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:40.616987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:40.617665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:40.618799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:40.619219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:40.745315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:40.753768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-de607096-d394-49e4-b99c-3d23ba55c258 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148106 Aug 22 19:43:40.754326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 993/1847] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:40 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:40.998826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:40.999418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:41.005832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:41.006311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:41.006748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:41.007442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:41.007925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:41.008351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:41.130433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:41.131069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:41.137543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:41.138019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:41.138446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:41.139135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:41.139581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:41.140027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:41.140555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:41.149110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d9841827-f672-4f9b-a84c-d7b5458040f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154083 Aug 22 19:43:41.150282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 855/1848] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:41.269366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:41.277938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4b9cb68f-b963-408b-b46a-70ac314671a7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151376 Aug 22 19:43:41.278509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 994/1849] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:41 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:41.774867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:41.775473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:41.781364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:41.781838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:41.782267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:41.782954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:41.783395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:41.783838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:41.907920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:41.916113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ad212d5-7757-44ee-a40b-1bc19745397f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.145078 Aug 22 19:43:41.916686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 856/1850] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:41 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:42.356323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:42.356969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:42.363891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:42.364374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:42.364804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:42.365500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:42.365944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:42.366363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:42.435671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:42.436339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:42.442398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:42.442882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:42.443374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:42.444486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:42.444608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:42.444979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:42.497574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:42.506226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1cd9eb1d-2f8d-44c8-852b-6104471de904 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.339168 Aug 22 19:43:42.506999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 995/1851] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:42.580049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:42.588980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b8373bab-fc65-4c0f-8524-626d300270f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.294922 Aug 22 19:43:42.589550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 857/1852] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:42 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:43.064590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:43.065698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:43.072156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:43.072640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:43.073075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:43.073763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:43.074211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:43.074635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:43.205434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:43.213837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7e54ef46-c38e-475c-bf98-f4a4550b7a3d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.280711 Aug 22 19:43:43.214410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 996/1853] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:43.527767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:43.528378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:43.534689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:43.535163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:43.535599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:43.536305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:43.536756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:43.537173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:43.609457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:43.610076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:43.615911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:43.616390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:43.616818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:43.617506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:43.617952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:43.619007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:43.673851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:43.682500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e8b09fe-a6da-48e8-85c4-212a9509e7d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.158984 Aug 22 19:43:43.683076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 858/1854] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:43 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:43.745372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:43.753536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-68399b4b-2f67-4678-9f7d-70cceb5b241f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147902 Aug 22 19:43:43.754096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 997/1855] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:43 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:44.236031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:44.236672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:44.242570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:44.243053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:44.243489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:44.244204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:44.244654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:44.245076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:44.374138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:44.382297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8f271fa-8ae9-4dcd-adc8-a43f13664ab9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150156 Aug 22 19:43:44.382864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 859/1856] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:44 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:44.703488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:44.704126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:44.710795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:44.711270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:44.711728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:44.712411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:44.712853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:44.713272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:44.773860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:44.774504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:44.780949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:44.781435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:44.781865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:44.782550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:44.782997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:44.783413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:44.840387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:44.849337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4c0bff03-4e4f-4fb2-96d6-38de94c7d991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149604 Aug 22 19:43:44.849907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 998/1857] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:44 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:44.910979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:44.919080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-278fb183-d8b4-400c-8ea1-6f1c4b1f9860 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149074 Aug 22 19:43:44.919660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 860/1858] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:44 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:45.404094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:45.404630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:45.410562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:45.411039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:45.411472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:45.412196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:45.412642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:45.413062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:45.544961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:45.553229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d4c690e9-bbba-44b5-b3c8-567c30e5a0fc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153039 Aug 22 19:43:45.553749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 999/1859] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:45 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:45.870903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:45.871509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:45.877892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:45.878365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:45.878797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:45.879597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:45.880074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:45.880494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:45.942015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:45.942699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:45.949141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:45.949619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:45.950051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:45.950736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:45.951181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:45.951600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:46.010212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:46.018412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b8641d1d-96c0-45c8-b857-6d226c9f4ce6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151999 Aug 22 19:43:46.018976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 861/1860] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:45 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:46.080084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:46.089094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8225867b-c400-4914-950e-1df280a9c6e6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151483 Aug 22 19:43:46.089657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1000/1861] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:45 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:46.576414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:46.577015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:46.583152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:46.583630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:46.584333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:46.585021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:46.585468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:46.585890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:46.716468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:46.724546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-741a4635-3472-4c41-bd19-7eef595ad1d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151926 Aug 22 19:43:46.725109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 862/1862] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:46 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:47.041099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:47.041732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:47.048205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:47.048688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:47.049126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:47.049819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:47.050272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:47.050700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:47.110188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:47.110860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:47.117262 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:47.117746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:47.118181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:47.118879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:47.119331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:47.119792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:47.183148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:47.191449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-34459870-4900-441d-88a3-3f2d627fa93c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154782 Aug 22 19:43:47.192054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1001/1863] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:47 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:47.247486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:47.255548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-394c9d5e-427a-45be-b20d-6e5f86f7de4e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149285 Aug 22 19:43:47.256142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 863/1864] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:47 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:47.746086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:47.746577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:47.752807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:47.753416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:47.754001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:47.754772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:47.755225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:47.755664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:47.886858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:47.895109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-068e1eff-9573-42d7-9486-5ef8d3bb5569 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153569 Aug 22 19:43:47.895919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1002/1865] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:47 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:48.213833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:48.214428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:48.220910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:48.221381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:48.221808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:48.222491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:48.222937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:48.223356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:48.225873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:48.278016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:48.278773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:48.285196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:48.285678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:48.286110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:48.286801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:48.287249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:48.287691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:48.292249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:48.357212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:48.365429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5506ad0f-0b96-41ed-97fe-b167cabae77e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.156382 Aug 22 19:43:48.366168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 864/1866] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:48 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:48.414804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:48.423705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3030314c-4018-4cd6-babf-14faeb6f14f4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150184 Aug 22 19:43:48.424268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1003/1867] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:48 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:48.916432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:48.917044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:48.922989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:48.923470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:48.923943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:48.924631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:48.925082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:48.925500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:49.050878 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:49.059049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-990acc9d-ca28-4f48-8c43-7d8a4ffb98e0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146398 Aug 22 19:43:49.059607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 865/1868] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:48 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:49.387884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:49.388450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:49.394741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:49.395210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:49.395631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:49.396343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:49.396784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:49.397200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:49.445250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:49.445861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:49.452934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:49.453411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:49.453863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:49.454533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:49.454981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:49.455402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:49.536641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:49.545481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-37c13a33-b3aa-4bea-9a5a-45010d8dc45f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.162304 Aug 22 19:43:49.546061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1004/1869] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:49 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:49.582796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:49.591177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-691322e4-0c42-42d4-9e0a-fe562f88cc67 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150316 Aug 22 19:43:49.591766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 866/1870] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:49 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:50.080567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:50.081105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:50.087800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:50.088282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:50.088718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:50.089404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:50.089854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:50.090276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:50.216385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:50.224458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7bb90468-6a5c-4425-95bf-3be95861aeb3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147783 Aug 22 19:43:50.225013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1005/1871] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:50 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:50.567226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:50.567871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:50.574233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:50.574713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:50.575150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:50.575869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:50.576323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:50.576747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:50.612659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:50.613275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:50.620401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:50.620893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:50.621350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:50.622050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:50.622497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:50.622921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:50.714350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:50.722520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2531cce7-862a-4dc0-9a42-faa3b16c5592 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.159110 Aug 22 19:43:50.723445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 867/1872] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:50 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:50.754981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:50.763605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5a63bfe7-47f1-4459-9cfa-124e250c4e28 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154696 Aug 22 19:43:50.764206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1006/1873] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:50 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:51.245938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:51.246557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:51.253736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:51.254223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:51.254666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:51.255359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:51.255850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:51.256278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:51.383373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:51.392431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f610556b-22f6-417b-81ff-52d407487b38 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150360 Aug 22 19:43:51.393007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 868/1874] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:51 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:51.745124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:51.745840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:51.752250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:51.752729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:51.753162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:51.753885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:51.754341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:51.754771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:51.784247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:51.784873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:51.792030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:51.792519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:51.792959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:51.793664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:51.794120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:51.794548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:51.885420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:51.894106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1fdf86d8-c343-429b-b225-8da46b7df50d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153315 Aug 22 19:43:51.894684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1007/1875] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:51 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:51.929200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:51.937848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7dd451f-c510-411e-bf6d-819030427289 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.157387 Aug 22 19:43:51.938437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 869/1876] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:51 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:52.413505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:52.414042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:52.420683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:52.421176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:52.421602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:52.422287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:52.422739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:52.423166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:52.550692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:52.558852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-59c500dd-6c4f-48a5-bb15-eca19df72d26 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149298 Aug 22 19:43:52.559416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1008/1877] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:52 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:52.918631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:52.919270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:52.925751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:52.926229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:52.926662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:52.927351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:52.927833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:52.928254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:52.958602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:52.959564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:52.966772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:52.967393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:52.968229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:52.968719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:52.969239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:52.969746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:53.062459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:53.072549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bfa36cb5-0598-4b1d-959d-05147ea049e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.157660 Aug 22 19:43:53.073420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 870/1878] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:52 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:53.109609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:53.118807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f3ac70d9-277e-4cbb-8188-cc9f887622b2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.163589 Aug 22 19:43:53.119378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1009/1879] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:52 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:53.579715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:53.580425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:53.586717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:53.587196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:53.587631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:53.588375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:53.588823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:53.589242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:53.719378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:53.728394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b2d0c08-1e3c-4f75-aed1-3bbe19332987 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151912 Aug 22 19:43:53.728963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 871/1880] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:53 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:54.093018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:54.093655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:54.100204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:54.100686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:54.101117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:54.101815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:54.102252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:54.103175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:54.138612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:54.139522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:54.146462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:54.147036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:54.147587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:54.148401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:54.148923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:54.149621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:54.232051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:54.240473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-18ee98ce-b173-49ff-b076-5388e14b9176 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151258 Aug 22 19:43:54.240980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1010/1881] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:54 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:54.278480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:54.286665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4111b9ed-c02e-4248-a1c1-fe33cbb75024 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151928 Aug 22 19:43:54.287224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 872/1882] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:54 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:54.749573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:54.750190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:54.756176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:54.756704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:54.757153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:54.757843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:54.758292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:54.759390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:54.888899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:54.897131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-984940af-d289-4681-9563-47d7f071da27 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151412 Aug 22 19:43:54.897723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1011/1883] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:54 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:55.263062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:55.263697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:55.270152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:55.270627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:55.271056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:55.271768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:55.272249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:55.272667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:55.308727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:55.309286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:55.316390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:55.316626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:55.317040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:55.317735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:55.318181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:55.318610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:55.401075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:55.409297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf6e3e9a-15cf-4bd1-930b-6f8059166357 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150741 Aug 22 19:43:55.415789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 873/1884] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:55 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:55.453774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:55.463082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2701ba58-95e2-4dab-9bba-572c8adf034a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.158652 Aug 22 19:43:55.463683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1012/1885] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:55 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:55.919285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:55.919915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:55.925856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:55.926328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:55.926756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:55.927436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:55.928007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:55.928426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:56.061463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:56.069573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-87ad40db-f114-4cdc-a780-0213bf1b848a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154788 Aug 22 19:43:56.070171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 874/1886] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:55 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:56.430418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:56.431051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:56.437509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:56.437985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:56.438413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:56.439091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:56.439535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:56.440194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:56.484649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:56.485260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:56.491586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:56.492121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:56.492551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:56.493240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:56.493687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:56.494106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:56.570381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:56.579279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-833754e4-40b4-44dc-9da2-b4181841b2cc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152710 Aug 22 19:43:56.579887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1013/1887] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:56 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:56.621932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:56.630114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c6615d2-c4e6-4622-8c4e-0a466e879777 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149347 Aug 22 19:43:56.630673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 875/1888] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:56 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:57.091063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:57.091708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:57.097659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:57.098140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:57.098580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:57.099269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:57.099740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:57.100164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:57.230408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:57.238423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b4762877-ddd5-4cc3-969a-c1506c623819 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151308 Aug 22 19:43:57.238979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1014/1889] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:57 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:57.601625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:57.602235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:57.609801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:57.610287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:57.610725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:57.611422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:57.611910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:57.612367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:57.652517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:57.653221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:57.659725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:57.660208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:57.660643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:57.661617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:57.662068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:57.662488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:57.744699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:57.753240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7967a275-7eee-4860-9165-9c377bb6ffbe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.155586 Aug 22 19:43:57.753815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 876/1890] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:57 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:57.793024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:57.801313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f3adb94b-ae91-4acb-92ce-bbca90818fe6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153274 Aug 22 19:43:57.801882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1015/1891] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:57 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:58.260983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:58.261590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:58.267558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:58.268074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:58.268505 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:58.269186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:58.269632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:58.270075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:58.396204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:58.404660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80f1ce49-eb24-47fd-b35e-f74e2f9b3615 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148364 Aug 22 19:43:58.405234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 877/1892] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:58 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:58.774818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:58.775419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:58.777747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=78 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:58.782930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:58.783406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:58.783865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:58.784548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:58.784993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:58.785410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:58.822493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:58.823192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:58.830051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:58.830543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:58.831008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:58.831734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:58.832190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:58.832609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:58.924794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:58.933119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-77c802a4-3b12-43e8-8df7-c251abb3331e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.162172 Aug 22 19:43:58.933694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1016/1893] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:58 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:58.961305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:58.970433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d10b4080-cb48-4667-9cdc-62d58b0a4f70 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151891 Aug 22 19:43:58.970996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 878/1894] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:58 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:43:59.425559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:59.426160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:59.432029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:59.432502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:59.432929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:59.433612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:59.434071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:59.434490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:59.559532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:43:59.567754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-42d14a88-f22e-497e-b542-f5952303681a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.145956 Aug 22 19:43:59.568308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1017/1895] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:59 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:43:59.954576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:59.955180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:59.957552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=78 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:59.963355 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:59.963863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:59.964314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:59.964999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:59.965445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:43:59.965865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:43:59.992279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:43:59.992892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:43:59.999281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:43:59.999721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:00.000154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:00.000844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:00.001289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:00.001711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:00.098063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:00.106155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8fc491a3-e687-409d-aa01-d00b66ce6353 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.155431 Aug 22 19:44:00.106722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 879/1896] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:59 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:00.133410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:00.141995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b64061b-8e5e-4eba-b50a-14565f8cbb53 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153775 Aug 22 19:44:00.142549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1018/1897] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:43:59 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:00.594022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:00.594561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:00.600632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:00.601109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:00.601546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:00.602233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:00.602688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:00.603138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:00.727195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:00.730016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:00.737201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cde4ca3a-ae70-496e-b6e0-d45d798f5b75 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147127 Aug 22 19:44:00.737774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 880/1898] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:00 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:01.127829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:01.128425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:01.135881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:01.136363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:01.136791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:01.137483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:01.137991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:01.138407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:01.163965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:01.164579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:01.171057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:01.171538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:01.172006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:01.172704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:01.173158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:01.173584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:01.269309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:01.271497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:01.278878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f4b452ba-1b36-4a0f-a0f4-c1c8a8b5039a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154858 Aug 22 19:44:01.279459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1019/1899] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:01 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:01.309989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:01.318358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0bfe08c9-6658-4b81-a1fb-7be8d4b65d6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.158519 Aug 22 19:44:01.318917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 881/1900] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:01 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:01.758065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:01.758713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:01.764845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:01.765326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:01.765761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:01.766450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:01.766937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:01.767357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:01.893069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:01.901679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ec6ed702-8177-4cf9-aa1d-e623625c2341 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147498 Aug 22 19:44:01.902239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1020/1901] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:01 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:02.300163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:02.300779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:02.307166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:02.307664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:02.308113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:02.308805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:02.309256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:02.309679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:02.340784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:02.342875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:02.348902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:02.349379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:02.349816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:02.350508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:02.350950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:02.351473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:02.445133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:02.454225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8710a3f8-8c3e-4d68-912e-8a98aa963a09 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.157846 Aug 22 19:44:02.455075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 882/1902] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:02 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:02.488198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:02.496349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cd24ef33-e00b-471f-98e8-ec97623fb35d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.160220 Aug 22 19:44:02.496915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1021/1903] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:02 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:02.922911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:02.923560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:02.929538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:02.930014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:02.930443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:02.931128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:02.931577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:02.932530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:03.061537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:03.069704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bd61fd35-576f-478a-af5b-6ad7d0224e47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150648 Aug 22 19:44:03.070267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 883/1904] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:02 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:03.476743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:03.477354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:03.484372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:03.484848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:03.485283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:03.485966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:03.486412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:03.486834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:03.516626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:03.517235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:03.533181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:03.533669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:03.534104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:03.536449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:03.536913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:03.537343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:03.627830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:03.644908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-50494aae-f78a-41ee-af45-11e8c93d7f98 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.172007 Aug 22 19:44:03.645500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1022/1905] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:03 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:03.679755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:03.688281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec1e55d3-81c5-4f3a-aa6b-6925664ec3b8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.175622 Aug 22 19:44:03.688850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 884/1906] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:03 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:04.091891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:04.092421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:04.098325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:04.098835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:04.099303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:04.100014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:04.100463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:04.100882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:04.230390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:04.238555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-51136050-a9b8-403d-9173-03b49d17aa1b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151592 Aug 22 19:44:04.239115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1023/1907] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:04 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:04.666939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:04.667556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:04.674084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:04.674564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:04.674998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:04.675721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:04.676172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:04.676585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:04.709233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:04.709851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:04.716909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:04.717385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:04.717814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:04.718507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:04.718948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:04.719364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:04.805540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:04.813855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-418de465-2c89-4483-9a7f-8a74c3b2e158 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150771 Aug 22 19:44:04.814430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 885/1908] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:04 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:04.849909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:04.858054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-505cc1aa-0d06-4de6-8460-38e23f318bac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152870 Aug 22 19:44:04.858613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1024/1909] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:04 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:05.260824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:05.261430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:05.267909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:05.268368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:05.268794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:05.269485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:05.269934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:05.270350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:05.399983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:05.408655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb386c95-4955-4138-9420-1d13ce5ca4c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152287 Aug 22 19:44:05.409237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 886/1910] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:05 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:05.835629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:05.836270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:05.842648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:05.843132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:05.843574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:05.844301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:05.844803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:05.845228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:05.879011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:05.879742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:05.887067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:05.887555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:05.888028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:05.888729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:05.889184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:05.889604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:05.975830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:05.984849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cb9dab45-329f-4fcc-b1c0-4ed6bb27b9f6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153280 Aug 22 19:44:05.985458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1025/1911] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:05 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:06.018917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:06.027215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5aee4c5f-03ec-4eab-b792-fd8ab50a2f1f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152193 Aug 22 19:44:06.027821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 887/1912] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:05 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:06.428912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:06.429524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:06.435495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:06.436007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:06.436438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:06.437119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:06.437628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:06.438082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:06.563778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:06.572030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d6eb96bd-723c-40dc-bdb6-044a340344d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146926 Aug 22 19:44:06.573210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1026/1913] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:06 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:07.006960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:07.007565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:07.014638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:07.015052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:07.015529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:07.016238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:07.016690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:07.017105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:07.048493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:07.049113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:07.055492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:07.056016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:07.056481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:07.057175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:07.057629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:07.058054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:07.191950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:07.201294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a3d01918-2578-4bc7-a31a-e7d9b525f464 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.156471 Aug 22 19:44:07.201889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1027/1914] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:07 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:07.381837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:07.390506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90ed5f48-1365-45a0-a8a0-3796cefeba93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.387485 Aug 22 19:44:07.391070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 888/1915] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:07 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:07.593990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:07.594554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:07.600487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:07.600964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:07.601395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:07.602080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:07.602557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:07.602973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:07.740792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:07.749630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-61229640-cdfe-4ab6-bfd7-ee7a5a82da84 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.159573 Aug 22 19:44:07.750284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1028/1916] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:07 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:08.222481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:08.223121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:08.230216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:08.230694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:08.231124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:08.231864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:08.232311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:08.232728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:08.360967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:08.369141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3fa208af-4f8e-433b-a372-6843933e9e3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150603 Aug 22 19:44:08.370299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 889/1917] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:08 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:08.411544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:08.412106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:08.419124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:08.419608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:08.420069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:08.420761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:08.421214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:08.421641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:08.549739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:08.558512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bcde18cb-2c3d-40a4-893b-e5aa1012c013 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150922 Aug 22 19:44:08.559078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1029/1918] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:08 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:08.770227 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:08.770859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:08.777309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:08.778011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:08.778245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:08.779519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:08.779519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:08.779803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:08.909066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:08.917849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3904b75d-1ace-491b-a14f-9ce2914ab7c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151450 Aug 22 19:44:08.918397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 890/1919] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:08 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:09.390494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:09.391102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:09.397590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:09.398012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:09.398463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:09.399146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:09.399591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:09.400032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:09.528369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:09.536550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9d152dd0-93a7-4cc3-bc30-bbf854dda764 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149932 Aug 22 19:44:09.537113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1030/1920] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:09 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:09.580401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:09.581011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:09.587612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:09.588118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:09.588550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:09.589852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:09.590341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:09.590763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:09.727686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:09.736526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3aa5548-a5a3-4b45-8a27-0c51093dfebd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.159939 Aug 22 19:44:09.737013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 891/1921] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:09 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:09.938894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:09.939515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:09.945369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:09.945854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:09.946288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:09.946979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:09.947428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:09.947878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:10.072520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:10.081382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d8235212-dbc6-46b7-84cf-e58589f2c732 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146243 Aug 22 19:44:10.081956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1031/1922] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:09 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:10.557347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:10.558640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:10.564669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:10.565157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:10.565596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:10.566291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:10.566747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:10.567174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:10.695314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:10.704172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bec3b2c-6f81-41cb-9b38-d775fb17523e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150710 Aug 22 19:44:10.704738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 892/1923] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:10 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:10.758360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:10.758966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:10.765904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:10.766381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:10.766810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:10.767492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:10.768003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:10.768431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:10.899571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:10.908332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a8060387-b85e-4b75-811f-34c570cc5930 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153709 Aug 22 19:44:10.909424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1032/1924] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:10 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:11.102634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:11.103158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:11.109681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:11.110158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:11.110595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:11.111362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:11.111885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:11.112306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:11.241366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:11.250092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ba661c1-6750-42bd-a1f5-f11e2b170a18 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151379 Aug 22 19:44:11.250656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 893/1925] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:11 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:11.726233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:11.726851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:11.733419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:11.733902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:11.734342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:11.735035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:11.735491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:11.736271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:11.861688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:11.869928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-deb701dc-2d3e-4a62-86f9-0ff74b1e4aec tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147611 Aug 22 19:44:11.870492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1033/1926] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:11 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:11.930562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:11.931175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:11.937562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:11.938047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:11.938481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:11.939169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:11.939624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:11.940069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:12.068719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:12.077363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-145612f9-413f-4be3-bb5c-3989804494fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150685 Aug 22 19:44:12.077936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 894/1927] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:11 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:12.271198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:12.271779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:12.277708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:12.278181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:12.278610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:12.279292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:12.279837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:12.280259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:12.406427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:12.414550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-64a14350-9153-4c38-8fff-9fa490f0cdde tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147458 Aug 22 19:44:12.415119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1034/1928] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:12 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:12.890356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:12.890961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:12.897040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:12.897516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:12.897947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:12.898634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:12.899112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:12.899529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:13.029822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:13.038636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1eddfe2-c0d3-4b69-8aae-fa780f035447 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152104 Aug 22 19:44:13.041282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 895/1929] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:12 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:13.099860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:13.100615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:13.107925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:13.108419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:13.108859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:13.109569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:13.110028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:13.110456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:13.244804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:13.252940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-66949774-982b-4a85-8342-16ebf7953828 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.157253 Aug 22 19:44:13.253502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1035/1930] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:13.436869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:13.437550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:13.443500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:13.444015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:13.444443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:13.445124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:13.445568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:13.445994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:13.574428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:13.582718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eed06cbe-1fd3-4b8d-b0db-d81b3a3fd937 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150411 Aug 22 19:44:13.583286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 896/1931] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:14.063276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:14.064292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:14.073306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.074655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.075365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.076523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.077298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.077999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.100129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:14.138800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:14.139400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:14.145829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.146316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.147168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.147546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.148030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.148464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.170248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:14.180449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:44:14.221507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:14.230421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0c7d1b4d-fb92-40b8-b19f-e566a8d5567a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.173626 Aug 22 19:44:14.231076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1036/1932] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:14 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:14.259467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fba2effa-6c64-4eb9-aca0-90197bba86ba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "DELETE /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 204 len: 0 microversion: 2.1 time: 0.124902 Aug 22 19:44:14.260361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 897/1933] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:44:14 2022] DELETE /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 19:44:14.268295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:14.268991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:14.274700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:14.275231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.275391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:14.275759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.276200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.276897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.277349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.277772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.281252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.282746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.282746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.282988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.283259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.283702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.413595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:14.422769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff17b8cd-0ca2-4137-b8b8-3a78aa79a476 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152199 Aug 22 19:44:14.423368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 898/1934] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:14.604683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:14.605840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:14.611959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.612445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.612886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.613581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:14.614032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:14.614448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:14.624712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:14.632965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a369e0a5-403f-4170-b392-81d3500a4e79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1718 microversion: 2.1 time: 0.368572 Aug 22 19:44:14.633542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1037/1935] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1718 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:14.745022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:14.753744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe306b26-e7ac-43ea-978d-dc44e4834052 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153050 Aug 22 19:44:14.754309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 899/1936] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:15.252268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:15.252881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:15.259620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:15.260192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:15.260631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:15.261388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:15.261839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:15.262268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:15.389607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:15.397867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b821395a-c69a-43ba-8eb8-282834391302 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149369 Aug 22 19:44:15.398363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1038/1937] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:15 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:15.444789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:15.445397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:15.452010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:15.452493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:15.452929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:15.453621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:15.454068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:15.454491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:15.655032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:15.655574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:15.661573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:15.662064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:15.662504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:15.663196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:15.663676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:15.664098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:15.669699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:15.679674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43fbfb77-d52c-48af-a795-7c33cde16835 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.238593 Aug 22 19:44:15.680268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 900/1938] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:15.775803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:15.776789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:15.782820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:15.783566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:15.784039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:15.785267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:15.785731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:15.786164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:15.813418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:15.821713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b86ad9e2-1bc3-4f1a-ba62-ccd81a2186ab tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1718 microversion: 2.1 time: 0.170822 Aug 22 19:44:15.822288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1039/1939] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:16.038921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:16.047909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-32feb3dc-2008-469d-b2b4-bc7762789883 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.275968 Aug 22 19:44:16.048481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 901/1940] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:15 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:16.419147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:16.419943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:16.426516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:16.427051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:16.427586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:16.428563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:16.429119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:16.429734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:16.521136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-521d9397-db96-4e17-a8ac-8b4599f0c385 req-b212b29f-42bc-4a24-8268-7b68f670e343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604c6a93-ddc1-4f33-81a5-f431e35b16a8", "name": "network-vif-deleted", "tag": "933102e5-36e2-4542-aa35-4f53ab839827"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:44:16.531946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-521d9397-db96-4e17-a8ac-8b4599f0c385 req-b212b29f-42bc-4a24-8268-7b68f670e343 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:16.532656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-521d9397-db96-4e17-a8ac-8b4599f0c385 req-b212b29f-42bc-4a24-8268-7b68f670e343 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:16.533246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-521d9397-db96-4e17-a8ac-8b4599f0c385 req-b212b29f-42bc-4a24-8268-7b68f670e343 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:16.553027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-521d9397-db96-4e17-a8ac-8b4599f0c385 req-b212b29f-42bc-4a24-8268-7b68f670e343 service nova] Creating event network-vif-deleted:933102e5-36e2-4542-aa35-4f53ab839827 for instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 on hv-cinder-83538 Aug 22 19:44:16.560425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-521d9397-db96-4e17-a8ac-8b4599f0c385 req-b212b29f-42bc-4a24-8268-7b68f670e343 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117718 Aug 22 19:44:16.561872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 902/1941] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:44:16.602305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:16.612038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-78cf1718-4ed1-45d6-bf6a-c6ef2388508f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.197283 Aug 22 19:44:16.612976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1040/1942] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:16 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:16.703794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:16.704913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:16.711440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:16.712036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:16.712537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:16.713297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:16.713805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:16.715167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:16.843621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:16.844252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:16.850377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:16.850915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:16.851345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:16.852124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:16.852569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:16.853057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:16.854523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:16.863732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a9ba683-013a-4f20-a1b1-208ca63dbd6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.164056 Aug 22 19:44:16.864457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 903/1943] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:16.915553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:16.924290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0843fe87-2c01-47f1-92df-3b2225c1e223 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084443 Aug 22 19:44:16.924856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1041/1944] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:16 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:17.068973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:17.069609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:17.075914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:17.076396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:17.076828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:17.077526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:17.077977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:17.078398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:17.215991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:17.224720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-783d1512-52b6-4c32-ad4d-ef9ff7ae1b54 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.159818 Aug 22 19:44:17.225403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 904/1945] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:17.634334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:17.634951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:17.641415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:17.641889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:17.642316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:17.643003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:17.643508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:17.643960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:17.785255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:17.794058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6dbacef6-4307-46a2-872e-973e881b8f77 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.163661 Aug 22 19:44:17.794618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1042/1946] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:17 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:17.885295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:17.886017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:17.892527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:17.893013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:17.893449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:17.894135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:17.894588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:17.895010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:17.945176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:17.945785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:17.952371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:17.952853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:17.953281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:17.953973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:17.954421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:17.954843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:18.016309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:18.024589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a6d09ae3-0377-4365-960b-055f9fa81ff3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083303 Aug 22 19:44:18.025170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1043/1947] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:17 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:18.030133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:18.038428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-031559a1-f0d5-49fb-986d-cf1eb31b53c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.156984 Aug 22 19:44:18.038983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 905/1948] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:18.246220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:18.246771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:18.252714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:18.253198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:18.253634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:18.254331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:18.254785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:18.255215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:18.379623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:18.388455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5835db0c-a0d7-4900-b0e9-2a1e0c5394eb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146210 Aug 22 19:44:18.389034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1044/1949] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:18 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:18.814340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:18.814995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:18.821573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:18.822057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:18.822515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:18.823188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:18.823661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:18.824593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:18.951107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:18.959785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-816210d2-9ac6-4430-81ef-9b138505f1b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149306 Aug 22 19:44:18.960353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 906/1950] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:18 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:19.045471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:19.046085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:19.052491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:19.053122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:19.053453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:19.054136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:19.054593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:19.055019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:19.059729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:19.060484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:19.066321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:19.066742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:19.067172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:19.067889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:19.068340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:19.068796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:19.119476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:19.128484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a423f041-0ab2-43a7-b359-a0c337025471 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086890 Aug 22 19:44:19.129058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1045/1951] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:19.202075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:19.210418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1ca0c281-a4e0-4fbd-9691-496c3bf587eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154954 Aug 22 19:44:19.210985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 907/1952] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:19 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:19.409541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:19.410072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:19.415959 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:19.416434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:19.416863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:19.417630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:19.418584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:19.419005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:19.543981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:19.552115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b627234-d0da-41db-a9f1-621729942f90 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146515 Aug 22 19:44:19.552683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1046/1953] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:19 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:19.982098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:19.982723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:19.989289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:19.989771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:19.990204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:19.990903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:19.991357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:19.991811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:20.120061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:20.128479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec94a076-71d5-4a89-8db5-5a50c6359659 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150906 Aug 22 19:44:20.129048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 908/1954] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:19 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:20.149401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:20.150016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:20.156912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:20.157387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:20.157824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:20.158515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:20.158967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:20.159392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:20.220578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:20.228554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b0b038f-072a-4024-b02f-e0f98a31694e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082984 Aug 22 19:44:20.229123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1047/1955] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:20 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:20.231673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:20.232307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:20.238546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:20.239030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:20.239470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:20.240197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:20.240656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:20.241087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:20.368126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:20.376930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3ef2a3b-5efd-4293-b98a-c45d6e8fbcd0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149087 Aug 22 19:44:20.377591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 909/1956] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:20 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:20.572180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:20.572714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:20.578783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:20.579298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:20.579768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:20.580464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:20.580918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:20.581344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:20.708449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:20.717282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d0fd6368-7467-46db-86f8-1ff0dd08ec73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149020 Aug 22 19:44:20.717839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1048/1957] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:20 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:21.149994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:21.150607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:21.157812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:21.158291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:21.158722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:21.159412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:21.159899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:21.160322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:21.248693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:21.249308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:21.255757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:21.256244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:21.256681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:21.257384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:21.257836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:21.258262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:21.291222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:21.299674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd3aceaf-12ba-4912-aba5-5869ef9d521e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153516 Aug 22 19:44:21.300273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 910/1958] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:21 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:21.319457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:21.328385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-417d7457-0928-43bc-a817-2db1ce0e4529 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083506 Aug 22 19:44:21.328943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1049/1959] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:21 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:21.398237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:21.398771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:21.404675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:21.405151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:21.405580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:21.406264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:21.406707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:21.407128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:21.533958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:21.542186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21eda0b5-e74c-44fa-a20f-c3be11f15f7e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.147858 Aug 22 19:44:21.542758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 911/1960] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:21.738826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:21.739436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:21.745341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:21.746466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:21.746900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:21.747579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:21.748056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:21.748474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:21.872182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:21.880311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-37200a77-f253-412d-9bda-69216cdec89e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.145353 Aug 22 19:44:21.880881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1050/1961] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:21 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:22.321177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:22.321713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:22.328221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:22.328703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:22.329137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:22.329825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:22.330276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:22.330695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:22.351385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:22.352043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:22.358599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:22.359083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:22.359518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:22.360239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:22.360692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:22.361116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:22.425130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:22.433335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cf933d0b-816b-46aa-965e-b3f06c50c372 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087747 Aug 22 19:44:22.433914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1051/1962] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:22 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:22.466311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:22.474343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37723f1b-4904-41d5-bfc5-e44f3e2c9e26 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.157112 Aug 22 19:44:22.474904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 912/1963] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:22 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:22.563300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:22.563948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:22.569873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:22.570353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:22.570793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:22.571563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:22.571995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:22.572422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:22.695943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:22.704720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-419dec39-7cc0-428a-869e-127866beb280 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.145235 Aug 22 19:44:22.705277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1052/1964] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:22.901434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:22.902480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:22.908477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:22.909084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:22.909628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:22.910409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:22.910952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:22.911442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:22.914143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:23.039127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:23.047874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71b8c545-caa1-46a6-af76-4129a12eeba4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150314 Aug 22 19:44:23.048435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 913/1965] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:22 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:23.453407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:23.454066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:23.460853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:23.461418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:23.462059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:23.462817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:23.463377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:23.463939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:23.468371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:23.494304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:23.494947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:23.502218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:23.502218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:23.502687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:23.503902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:23.504467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:23.504827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:23.537460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:23.545903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-618a4fa1-841c-471e-b8bb-ae2044993ef9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.096925 Aug 22 19:44:23.546477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1053/1966] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:23 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:23.641903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:23.650055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-210cecaa-776f-46c2-875c-01b1666b444c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.159565 Aug 22 19:44:23.650628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 914/1967] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:23 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:23.727472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:23.728111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:23.734071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:23.734548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:23.734982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:23.735703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:23.736163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:23.736686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:23.865773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:23.874361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f62c04b0-2fac-47a4-b3cc-d296402f621a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150766 Aug 22 19:44:23.874919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1054/1968] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:24.068689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:24.069353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:24.075238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:24.075754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:24.076194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:24.076886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:24.077346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:24.077770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:24.203145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:24.211514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2c57423-9143-4ccc-9f07-ce68d2c7da15 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146672 Aug 22 19:44:24.212100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 915/1969] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:24 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:24.567031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:24.567672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:24.574166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:24.574700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:24.575144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:24.575888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:24.576346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:24.576779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:24.639300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:24.647349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2d7e6ed0-0bd7-4b91-a075-840ce7710412 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084386 Aug 22 19:44:24.647946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1055/1970] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:24.670741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:24.671353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:24.677849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:24.678340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:24.678783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:24.679572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:24.680059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:24.680488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:24.806500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:24.814737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed5fb544-139b-46b5-aaa9-21fe9dedd776 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148321 Aug 22 19:44:24.815716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 916/1971] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:24 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:24.894824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:24.895370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:24.901756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:24.902891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:24.903357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:24.904070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:24.904515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:24.904932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:25.030407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:25.038596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fbd58a1a-ffc0-4887-85ea-38fc763a2b12 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.147676 Aug 22 19:44:25.039164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1056/1972] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:25.232595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:25.233214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:25.239087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:25.239576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:25.240040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:25.240728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:25.241179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:25.241602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:25.373790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:25.382175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b51a5f11-fb4c-454f-89c5-8e324731d667 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153406 Aug 22 19:44:25.383018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 917/1973] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:25 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:25.668976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:25.669587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:25.676211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:25.676692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:25.677128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:25.677815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:25.678266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:25.678694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:25.742452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:25.751284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dc83de48-7f58-4591-b43e-c2dbc234091d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086685 Aug 22 19:44:25.751881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1057/1974] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:25 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:25.837464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:25.838096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:25.844929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:25.845404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:25.845832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:25.846547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:25.846992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:25.847409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:25.973701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:25.982450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9eceb8e-3767-448e-89ee-29d43df6bbc0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149105 Aug 22 19:44:25.983022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 918/1975] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:25 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:26.059852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:26.060487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:26.066394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:26.066872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:26.067309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:26.068028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:26.068483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:26.068908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:26.194315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:26.203050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e16acf57-3d73-4455-92e4-298c516a6fbb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.147085 Aug 22 19:44:26.203636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1058/1976] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:26 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:26.405040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:26.405634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:26.411552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:26.412060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:26.412489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:26.413175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:26.413623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:26.414069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:26.544203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:26.552325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-917b316d-5a8c-4d6d-b0fd-1b3240e3be2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151770 Aug 22 19:44:26.552897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 919/1977] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:26 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:26.772023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:26.772574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:26.779026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:26.779501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:26.779991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:26.780677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:26.781123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:26.781541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:26.843133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:26.851827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4cc3e6a0-f58e-4096-8fe2-eab5217ae0ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083687 Aug 22 19:44:26.852394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1059/1978] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:26 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:27.003503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:27.004139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:27.010534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:27.011010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:27.011717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:27.012407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:27.012856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:27.013275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:27.140077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:27.148718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e98fb9de-85f4-40d1-9c7f-300f852ab950 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149367 Aug 22 19:44:27.149320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 920/1979] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:26 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:27.224376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:27.224988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:27.231410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:27.231924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:27.232362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:27.233050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:27.233500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:27.233924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:27.363151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:27.371486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ef109241-e786-48e2-9e8c-cfbee985c29e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150913 Aug 22 19:44:27.372093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1060/1980] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:27.574096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:27.574643 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:27.580680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:27.581157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:27.581587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:27.582272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:27.582717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:27.583133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:27.710531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:27.719264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36c4b1ab-25f6-4736-a491-a2bdd7b4dc03 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149147 Aug 22 19:44:27.719855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 921/1981] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:27 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:27.874276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:27.875094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:27.882168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:27.882655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:27.883098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:27.883836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:27.884297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:27.884728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:27.945122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:27.953634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-34086c3c-0966-45fe-b8da-22026990ad53 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084246 Aug 22 19:44:27.954202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1061/1982] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:28.169702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:28.170315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:28.176470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:28.176982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:28.177413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:28.178098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:28.178551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:28.178977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:28.307567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:28.316214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df251a4e-ea3d-4ae6-8e57-b03efc6fd7fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150396 Aug 22 19:44:28.316782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 922/1983] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:28 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:28.393661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:28.394274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:28.400339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:28.400764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:28.401195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:28.401878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:28.402331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:28.402756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:28.529292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:28.537346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1ae33d64-c6fe-4e98-ace9-6481ee114820 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.147577 Aug 22 19:44:28.537910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1062/1984] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:28.740136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:28.740738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:28.747242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:28.747739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:28.748171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:28.748853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:28.749300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:28.749713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:28.875618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:28.884566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b3ba2e5-2c7a-4f25-ada4-ebf79303d899 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148282 Aug 22 19:44:28.885126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 923/1985] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:28 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:28.974625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:28.975231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:28.977524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=94 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:28.983296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:28.983799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:28.984233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:28.984912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:28.985359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:28.985777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:29.052062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:29.060179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0be4cd78-8a84-42a3-aa3c-902416a36ab7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.089312 Aug 22 19:44:29.060745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1063/1986] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:28 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:29.338038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:29.338686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:29.345828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:29.346310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:29.346740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:29.347433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:29.347904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:29.348326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:29.477861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:29.486061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c63e9a61-0bb8-4f4b-a401-2ed275bebabb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152339 Aug 22 19:44:29.486629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 924/1987] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:29 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:29.558756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:29.559379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:29.565595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:29.566025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:29.566456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:29.567137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:29.567587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:29.568059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:29.696723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:29.705674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f20bf6fc-347e-4f04-b0bc-4d8a331fb2b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151181 Aug 22 19:44:29.706276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1064/1988] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:29.905241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:29.905769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:29.912731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:29.913215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:29.913648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:29.914344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:29.914796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:29.915221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:30.044613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:30.053790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-360a3811-577e-408b-be33-93952d8725a3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152508 Aug 22 19:44:30.054355 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 925/1989] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:29 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:30.080297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:30.080905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:30.087409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:30.087944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:30.088375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:30.089051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:30.089497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:30.089944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:30.157513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:30.165589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-30f953da-31c9-4db8-811e-aff1626e7034 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.089076 Aug 22 19:44:30.166151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1065/1990] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:30.506278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:30.506885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:30.509229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:30.515226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:30.515737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:30.516169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:30.516860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:30.517329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:30.517742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:30.647916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:30.656040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acf056ce-b32e-4cdc-b419-ff57228a91e1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153560 Aug 22 19:44:30.656613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 926/1991] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:30 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:30.726263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:30.726870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:30.733562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:30.734034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:30.734464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:30.735140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:30.735582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:30.736024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:30.863886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:30.872682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f06b7364-af96-4316-ad8a-2eb39332be1b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150244 Aug 22 19:44:30.873252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1066/1992] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:30 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:31.076060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:31.076601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:31.082506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:31.082991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:31.083429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:31.084155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:31.084864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:31.085292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:31.186195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:31.186815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:31.193199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:31.193684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:31.194120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:31.194810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:31.195259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:31.195700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:31.211768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:31.220810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8974400-70d0-4b82-8805-d0e963b8d85e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148793 Aug 22 19:44:31.221465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 927/1993] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:31 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:31.256665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:31.264924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-67981deb-05c1-4d2b-92bd-5fc4bb6cdae9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082511 Aug 22 19:44:31.265490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1067/1994] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:31.677799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:31.678428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:31.684877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:31.685344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:31.685783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:31.686473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:31.686920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:31.687338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:31.816802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:31.825422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b4443e8-8956-4c37-83b8-0299b9461885 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151512 Aug 22 19:44:31.825999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 928/1995] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:31 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:31.893722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:31.894332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:31.900484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:31.900967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:31.901401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:31.902088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:31.902539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:31.902961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:32.028489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:32.036537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-58c9fd5b-0498-4676-9f84-af53e2c67f7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.146729 Aug 22 19:44:32.037100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1068/1996] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:32.241942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:32.242484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:32.249432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:32.249918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:32.250356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:32.251081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:32.251606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:32.251985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:32.285751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:32.286475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:32.293107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:32.293675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:32.294111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:32.294799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:32.295247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:32.295683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:32.361323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:32.363577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:32.370669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7e146541-234e-48b8-89ac-f0c49327bde3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088717 Aug 22 19:44:32.371935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1069/1997] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:32 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:32.384871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:32.387081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:32.394194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0a3bdeb-9bc6-43aa-9055-d7e4bfb30382 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156171 Aug 22 19:44:32.394757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 929/1998] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:32 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:32.846624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:32.847262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:32.853447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:32.853918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:32.854350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:32.855025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:32.856197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:32.856616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:32.982332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:32.990457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ee3b1634-77a9-4335-9d28-462cf1f879af tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147643 Aug 22 19:44:32.991028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1070/1999] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:32 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:33.057852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:33.059090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:33.065598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:33.066070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:33.066501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:33.067182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:33.067628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:33.068070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:33.197314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:33.205424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79f59a89-7d8b-4e37-b9d4-1de3171ba4e9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151344 Aug 22 19:44:33.205979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 930/2000] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:33 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:33.392275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:33.392923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:33.398869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:33.399287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:33.399746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:33.400435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:33.400880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:33.401301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:33.414642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:33.415255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:33.421790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:33.422271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:33.422708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:33.423402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:33.423879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:33.424303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:33.463411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:33.472277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-026f22b9-5afe-4dcc-b9c8-1f4776672d70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083890 Aug 22 19:44:33.472953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1071/2001] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:33 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:33.557181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:33.565557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92157cbd-73fa-4d99-91f9-1f655647ff07 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154806 Aug 22 19:44:33.566125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 931/2002] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:33 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:34.012316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:34.012937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:34.020075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:34.020654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:34.021097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:34.021795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:34.022252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:34.022679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:34.153753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:34.162114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a5b34037-db56-4cfd-bc06-931c47c39a98 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154211 Aug 22 19:44:34.162676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1072/2003] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:34 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:34.226398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:34.227014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:34.233503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:34.233979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:34.234412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:34.235100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:34.235551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:34.236002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:34.362755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:34.371552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10e0e345-2c06-4356-8dd4-7ce4653af96b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148575 Aug 22 19:44:34.372145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 932/2004] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:34.493399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:34.494013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:34.500560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:34.501041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:34.501476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:34.502170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:34.502620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:34.503043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:34.562303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:34.570282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4d3c1cf8-c665-40df-ac10-672294852711 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.080780 Aug 22 19:44:34.570845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1073/2005] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:34.586972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:34.587605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:34.593654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:34.594129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:34.594557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:34.595242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:34.595710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:34.596131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:34.722332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:34.731037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51c5a922-18bb-4197-b210-e2924f1956dd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147867 Aug 22 19:44:34.731597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 933/2006] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:34 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:35.182758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:35.183385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:35.189745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:35.190220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:35.190648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:35.191323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:35.191795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:35.192216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:35.321905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:35.330498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-350ba4dc-decc-4ae1-a296-b4a40bbd1b88 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151537 Aug 22 19:44:35.331081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1074/2007] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:35 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:35.393231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:35.393892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:35.400610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:35.400791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:35.401267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:35.402688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:35.403242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:35.403692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:35.533934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:35.542095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4c8f945-0a2b-4d9f-ad29-af1a06db2cac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152708 Aug 22 19:44:35.542655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 934/2008] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:35.590482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:35.591069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:35.597212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:35.597690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:35.598120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:35.598793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:35.599235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:35.599678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:35.662661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:35.670688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-36edb1a4-2aa1-4eb3-8e62-f436d4596744 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084092 Aug 22 19:44:35.671252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1075/2009] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:35 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:35.752440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:35.753051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:35.759045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:35.759527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:35.759997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:35.760688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:35.761136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:35.762226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:35.889792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:35.897993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab06545a-28f0-4cda-bd93-d05f6c31c3ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149407 Aug 22 19:44:35.898559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 935/2010] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:35 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:36.352268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:36.352883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:36.359363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:36.359886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:36.360324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:36.361009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:36.361463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:36.361883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:36.488442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:36.497139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bc7abb89-4cbb-4dcd-bf46-42e969067efb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148710 Aug 22 19:44:36.497706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1076/2011] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:36 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:36.562930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:36.563567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:36.569920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:36.570392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:36.570828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:36.571508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:36.571987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:36.572405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:36.692018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:36.692701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:36.698535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:36.699019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:36.699443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:36.700223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:36.700676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:36.701092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:36.705996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:36.713102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4566f2d5-b9d8-4221-8d3f-93cc2211c44e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154475 Aug 22 19:44:36.713677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 936/2012] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:36.762509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:36.770762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b60a13bf-86c6-4e91-b1c6-392320a1557f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083000 Aug 22 19:44:36.771320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1077/2013] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:36.920965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:36.921578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:36.927509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:36.928022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:36.928457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:36.929142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:36.929592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:36.930013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:37.054653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:37.063372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-799b1e1c-af63-4649-b387-2cded5936ca5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146776 Aug 22 19:44:37.063968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 937/2014] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:36 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:37.517837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:37.518452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:37.524838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:37.525315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:37.525746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:37.526436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:37.526881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:37.528041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:37.655531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:37.664244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-79cfca56-4901-443b-a0cb-23242d802e20 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150595 Aug 22 19:44:37.664830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1078/2015] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:37 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:37.734556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:37.735167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:37.741744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:37.742226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:37.742657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:37.743349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:37.743832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:37.744258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:37.794373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:37.795573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:37.802090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:37.802585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:37.802999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:37.803710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:37.804162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:37.804580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:37.870209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:37.881127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5fe4820b-eb19-42ea-b1de-1846f416c238 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.094167 Aug 22 19:44:37.881325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:37.881739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1079/2016] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:37.890559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8eb0b4b9-a81c-4b04-bdf3-f1b947a8e721 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.159875 Aug 22 19:44:37.891114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 938/2017] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:37 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:38.085187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:38.085793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:38.091707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:38.092187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:38.092616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:38.093296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:38.093742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:38.094158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:38.221282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:38.229363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9be2f3c7-fe0d-4e61-bcdc-d786dc03ee43 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148872 Aug 22 19:44:38.229925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1080/2018] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:38 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:38.685569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:38.686172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:38.692215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:38.692688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:38.693119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:38.693801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:38.694252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:38.694675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:38.820608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:38.828728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-949d52d6-e853-4a1d-a27d-9e56b47ccd0d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146981 Aug 22 19:44:38.829286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 939/2019] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:38 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:38.902789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:38.903391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:38.910140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:38.910655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:38.911094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:38.911423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:38.911868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:38.912077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:38.912321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:38.912773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:38.918521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:38.919006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:38.919447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:38.920179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:38.920648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:38.921053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:38.977883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:38.986126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-30622a0c-06e6-4f91-b5f9-7839fd0384b6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087699 Aug 22 19:44:38.986698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1081/2020] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:39.052358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:39.060536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ef99a53-6827-46e1-a2fb-62ff936ce941 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152880 Aug 22 19:44:39.061095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 940/2021] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:39.250465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:39.251035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:39.256991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:39.257474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:39.257908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:39.258599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:39.259047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:39.259468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:39.385124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:39.394223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7a8cf1ed-1216-44fd-8d5a-0c8ed484080e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147682 Aug 22 19:44:39.394794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1082/2022] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:39 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:39.849455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:39.850134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:39.856466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:39.856945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:39.857373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:39.858061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:39.858516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:39.858925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:39.988630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:39.996706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08e98e3f-f0a9-40a9-a705-9a6d027758c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151112 Aug 22 19:44:39.997273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 941/2023] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:39 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:40.006247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:40.006884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:40.013839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:40.014318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:40.014752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:40.015439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:40.015928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:40.016351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:40.078071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:40.083594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:40.084939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:40.089685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-139d6c1f-c2d5-473b-92d5-45470b37e01c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086704 Aug 22 19:44:40.090632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1083/2024] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:40.093567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:40.094044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:40.094476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:40.095166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:40.095612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:40.096065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:40.223976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:40.232088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a0052815-b3ce-4f95-b6b2-a6c1887eae83 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153277 Aug 22 19:44:40.232648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 942/2025] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:40.414751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:40.415281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:40.421793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:40.422265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:40.422693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:40.423369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:40.423843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:40.424264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:40.552217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:40.560222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-00cfb1eb-ac68-47b8-95c2-f729b3858ea2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149419 Aug 22 19:44:40.560788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1084/2026] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:40 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:41.018465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:41.019091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:41.025425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:41.025901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:41.026331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:41.027016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:41.027461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:41.027901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:41.111402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:41.112515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:41.120184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:41.120676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:41.121114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:41.121820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:41.122298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:41.122722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:41.163808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:41.172642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55e56168-3aec-4067-922f-3d99675764fd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.157959 Aug 22 19:44:41.173221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 943/2027] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:41 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:41.188319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:41.196877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3323610b-1571-4b99-8630-622b18a258f2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.089398 Aug 22 19:44:41.197726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1085/2028] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:41.253149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:41.253761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:41.259555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:41.260088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:41.260532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:41.261233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:41.262192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:41.262621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:41.418154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:41.426928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45e6c083-7d47-40d1-b804-187436dcae35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.177540 Aug 22 19:44:41.427509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 944/2029] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:41 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:41.580662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:41.581160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:41.587248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:41.587758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:41.588191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:41.588877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:41.589320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:41.589808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:41.604627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:41.718107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:41.726417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fb69bd90-fe7f-4a43-9192-3e05c2deae6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149684 Aug 22 19:44:41.726987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1086/2030] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:41 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:42.193769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:42.194376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:42.200776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:42.201252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:42.201681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:42.202361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:42.202807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:42.203220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:42.217678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:42.218292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:42.224704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:42.225184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:42.225620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:42.226311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:42.226767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:42.227262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:42.294155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:42.302305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4c65b5f4-7047-471b-8353-e5e59fc08dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088399 Aug 22 19:44:42.302884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1087/2031] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:42.335959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:42.344541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4c6a8e0-7633-4136-90e0-4d1f26712af3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154692 Aug 22 19:44:42.345105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 945/2032] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:42 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:42.448454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:42.449021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:42.454902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:42.455384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:42.455856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:42.456532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:42.456975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:42.457390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:42.581748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:42.590855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f1c41c9d-c6dd-4fc4-b2f4-1f87126caf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.146259 Aug 22 19:44:42.591427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1088/2033] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:42.747271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:42.747869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:42.753924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:42.754403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:42.754836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:42.755523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:42.756011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:42.756452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:42.771628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:42.886862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:42.895083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efc34f9b-2816-4e90-8fca-eed57bac8b47 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151779 Aug 22 19:44:42.895670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 946/2034] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:43.323369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:43.324070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:43.330580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:43.331073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:43.331515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:43.332264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:43.332746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:43.333171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:43.365977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:43.366714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:43.373287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:43.373864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:43.374368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:43.375143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:43.375679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:43.376180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:43.396394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:43.405193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-10f2055a-3967-4179-9a1f-936429ebcffb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085710 Aug 22 19:44:43.405757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1089/2035] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:43.504087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:43.512799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0c1c145-9d2c-4db3-9af9-ea26cd19e7d9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150571 Aug 22 19:44:43.513382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 947/2036] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:43 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:43.612466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:43.613083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:43.619077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:43.619542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:43.619996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:43.620758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:43.621724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:43.622140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:43.749976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:43.758111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-68615af0-420c-47b4-b0fc-c6bd080dad53 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149854 Aug 22 19:44:43.758682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1090/2037] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:43 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:43.916538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:43.917153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:43.923763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:43.924243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:43.924681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:43.925373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:43.925824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:43.926249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:44.054943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:44.063051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22651fec-0955-4079-81da-41045b5d3bcd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150365 Aug 22 19:44:44.063613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 948/2038] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:43 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:44.426781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:44.427341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:44.433931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:44.434418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:44.434886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:44.435578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:44.436058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:44.436480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:44.497320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:44.505458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3f6b934a-db2b-4ba6-94ad-0fac12a38681 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082655 Aug 22 19:44:44.506023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1091/2039] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:44 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:44.534156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:44.534769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:44.541135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:44.541620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:44.542056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:44.542748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:44.543204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:44.543631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:44.672457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:44.680438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9693c31c-ad85-4f2e-acbe-eab32cf8e4d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150208 Aug 22 19:44:44.681007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 949/2040] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:44 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:44.779882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:44.780487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:44.786381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:44.786855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:44.787281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:44.788013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:44.788456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:44.788871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:44.914733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:44.923424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f243c6ac-9542-4644-b929-4211f75e9263 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.147444 Aug 22 19:44:44.924051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1092/2041] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:44 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:45.083922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:45.084709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:45.090605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:45.091091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:45.091529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:45.092246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:45.092694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:45.093116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:45.223696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:45.232296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b46303bd-ddd2-4478-95bf-022580de53f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152412 Aug 22 19:44:45.232866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 950/2042] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:45 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:45.526429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:45.527557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:45.534473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:45.534961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:45.535398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:45.536125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:45.536579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:45.537008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:45.601899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:45.610594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-36a2cff3-9e9b-48e5-acef-942e656176b5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088086 Aug 22 19:44:45.611163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1093/2043] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:45 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:45.702039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:45.702814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:45.709315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:45.710053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:45.710489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:45.711183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:45.711635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:45.712082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:45.838933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:45.848026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2ede0bb8-298b-426c-be5c-46347956abed tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150419 Aug 22 19:44:45.848599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 951/2044] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:45 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:45.945234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:45.945848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:45.952379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:45.952891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:45.953331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:45.954015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:45.954466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:45.954886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:46.080438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:46.088967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-88a6205c-db10-4561-887a-8ef3745242c2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.147553 Aug 22 19:44:46.090075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1094/2045] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:45 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:46.253045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:46.253658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:46.259592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:46.260103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:46.260538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:46.261228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:46.262329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:46.262751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:46.390581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:46.398613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-908b27a6-ba76-4a62-9929-c114b48357ac tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149448 Aug 22 19:44:46.399186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 952/2046] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:46 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:46.631880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:46.632530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:46.640156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:46.640794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:46.641273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:46.642063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:46.642609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:46.643108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:46.706242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:46.715364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-09983c76-fa1d-41d8-8e58-90d2590ce829 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086815 Aug 22 19:44:46.715978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1095/2047] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:46.868684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:46.869295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:46.876407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:46.876884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:46.877344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:46.878029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:46.878507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:46.878925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:47.007295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:47.015873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d982c10-0834-4986-8eeb-856f8af74025 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150984 Aug 22 19:44:47.016438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 953/2048] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:46 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:47.112333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:47.112944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:47.119169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:47.119662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:47.120106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:47.121354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:47.121802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:47.122215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:47.250717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:47.258762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-037c31cc-3c3c-4913-af39-a0ab09b4cc06 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150220 Aug 22 19:44:47.259324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1096/2049] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:47 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:47.421127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:47.421745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:47.427707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:47.428213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:47.428632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:47.429320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:47.429776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:47.430203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:47.557689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:47.566496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4f83873-9870-4ccf-b354-9f42eb47f2f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149854 Aug 22 19:44:47.567207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 954/2050] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:47 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:47.735717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:47.736331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:47.742750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:47.743226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:47.743675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:47.744358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:47.744806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:47.745225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:47.805635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:47.813675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ff28cbc2-c590-4792-b513-f6d2ab7439e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081846 Aug 22 19:44:47.814240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1097/2051] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:48.036799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:48.037363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:48.043847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:48.044335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:48.044771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:48.045464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:48.045914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:48.046361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:48.176299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:48.184531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4d3343d-4c48-4d3b-8bf8-d5c92db36590 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151702 Aug 22 19:44:48.185099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 955/2052] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:48 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:48.280317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:48.280922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:48.286863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:48.287284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:48.287750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:48.288436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:48.288882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:48.289301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:48.416235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:48.425001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3c345321-e2c5-4c44-9854-6570aa631f00 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149292 Aug 22 19:44:48.425601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1098/2053] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:48 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:48.588564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:48.589106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:48.595521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:48.596038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:48.596476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:48.597166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:48.597618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:48.598043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:48.724177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:48.732279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57955a70-a931-4510-a2a7-81f71f7b4eb9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147869 Aug 22 19:44:48.732839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 956/2054] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:48 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:48.833932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:48.834916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:48.841966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:48.842386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:48.842816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:48.843501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:48.843972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:48.844389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:48.908206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:48.916381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ff78527f-d804-4398-9448-26454ac581af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086267 Aug 22 19:44:48.916942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1099/2055] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:49.206116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:49.206732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:49.213421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:49.213903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:49.214349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:49.215617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:49.216091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:49.216517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:49.346404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:49.354598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44575eee-48b2-4582-bf51-76a5546ab911 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152531 Aug 22 19:44:49.355781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 957/2056] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:49 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:49.446551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:49.447158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:49.453740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:49.454214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:49.454642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:49.455318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:49.455790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:49.456209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:49.580202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:49.588576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b18d442c-375f-4ab2-9e84-9076f5ba24d3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.146185 Aug 22 19:44:49.589133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1100/2057] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:49 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:49.753369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:49.753923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:49.759869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:49.760344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:49.760778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:49.761971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:49.762413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:49.762829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:49.888946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:49.897170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eebc8668-186f-40eb-81c2-e75324097b8f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147734 Aug 22 19:44:49.897749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 958/2058] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:49 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:49.937092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:49.937705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:49.944158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:49.944636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:49.945068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:49.945753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:49.946210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:49.946636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:50.014408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:50.022695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a51e76c7-cbe0-4212-9e63-1ac8c150c8a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.089865 Aug 22 19:44:50.023261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1101/2059] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:50.376140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:50.376683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:50.382977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:50.383457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:50.383930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:50.384621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:50.385071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:50.385492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:50.510661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:50.519335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5946fca6-0547-4b0d-b727-fa084ccf13db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147143 Aug 22 19:44:50.519924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 959/2060] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:50 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:50.610510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:50.611118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:50.617128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:50.617603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:50.618034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:50.618713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:50.619155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:50.619569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:50.748979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:50.757170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6b4bf3b0-a149-4226-981e-b9bb3b73529c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150389 Aug 22 19:44:50.757744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1102/2061] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:50 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:50.918246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:50.919412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:50.925794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:50.926276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:50.926758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:50.927406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:50.927886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:50.928309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:51.042391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:51.043012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:51.049602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:51.050343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:51.050510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:51.051202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:51.051668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:51.052111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:51.056181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:51.064294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:51.072777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83024c7e-633d-44e5-9ae5-d746296600c0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.158347 Aug 22 19:44:51.073356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 960/2062] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:50 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:51.117218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:51.125702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-edb96506-fcb9-44b7-9e67-992ee405059e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086981 Aug 22 19:44:51.126270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1103/2063] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:51 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:51.540445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:51.541030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:51.547409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:51.547926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:51.548365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:51.549058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:51.549508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:51.549929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:51.679150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:51.687910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4213d6fc-2251-48da-9868-545fcb8b337d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151316 Aug 22 19:44:51.688473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 961/2064] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:51 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:51.778650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:51.779265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:51.785320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:51.785801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:51.786238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:51.786926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:51.787377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:51.787838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:51.916929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:51.925646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c8864572-2e1b-4310-b662-4fc2a0d687f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150790 Aug 22 19:44:51.926209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1104/2065] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:51 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:52.095051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:52.095686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:52.101661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:52.102136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:52.102567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:52.103255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:52.103728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:52.104148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:52.147525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:52.148295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:52.155280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:52.155804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:52.156243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:52.156941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:52.157393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:52.157857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:52.223987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:52.232832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ee373269-4328-4121-99fe-4b6cb6eab355 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.089296 Aug 22 19:44:52.233407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1105/2066] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:52.236689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:52.244829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb2d54a7-a390-4b62-84ff-c8859720b46d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153654 Aug 22 19:44:52.245389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 962/2067] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:52 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:52.708495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:52.709114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:52.715361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:52.715928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:52.716326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:52.717666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:52.718112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:52.718539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:52.842786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:52.850978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-61725a4c-1fcd-4f5f-86d5-abb6acc5a6ab tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146338 Aug 22 19:44:52.851553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1106/2068] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:52 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:52.947106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:52.947742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:52.954782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:52.955263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:52.955721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:52.956417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:52.956866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:52.957294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:52.961449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:53.086788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:53.094959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b16d056-5a33-40a4-b5ba-0d6cae6b9636 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151676 Aug 22 19:44:53.095527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 963/2069] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:52 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:53.253326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:53.253891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:53.260240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:53.260717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:53.261149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:53.261839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:53.262285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:53.262704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:53.266442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:53.267058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:53.272874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:53.273348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:53.273780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:53.274540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:53.274991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:53.275411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:53.325293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:53.333982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a0947819-b24c-4407-86ee-5af8a5a2296a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084539 Aug 22 19:44:53.334813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1107/2070] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:53.408084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:53.416142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0bd5dc0b-844a-48e8-b96b-1fbf638ce365 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154313 Aug 22 19:44:53.416710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 964/2071] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:53 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:53.871888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:53.872503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:53.879063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:53.879544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:53.880006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:53.880691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:53.881137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:53.881560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:54.011144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:54.019380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9d5e1995-18c9-4666-8dcd-8e01c36a815d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151367 Aug 22 19:44:54.019979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1108/2072] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:53 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:54.116113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:54.116654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:54.123705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:54.124187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:54.124616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:54.125305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:54.125748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:54.126163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:54.252456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:54.260638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aad522d2-6a96-4a8c-b766-08d1d62467f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148492 Aug 22 19:44:54.261210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 965/2073] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:54 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:54.355231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:54.356148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:54.362567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:54.363046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:54.363482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:54.364275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:54.364725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:54.365145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:54.425475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:54.433654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-41e86b2a-ce4f-47c1-ba97-b82f3937e921 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082255 Aug 22 19:44:54.434221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1109/2074] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:54.437585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:54.438224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:54.444237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:54.444718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:54.445161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:54.445913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:54.446378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:54.446802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:54.570973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:54.579796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e3b2852-8077-4e64-9ae3-26be2cc2345d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146565 Aug 22 19:44:54.580366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 966/2075] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:54 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:55.040138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:55.040754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:55.047386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:55.047902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:55.048332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:55.049010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:55.049456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:55.049877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:55.178939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:55.187162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ac6b40fc-223d-4637-a821-464ca5977235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150879 Aug 22 19:44:55.187749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1110/2076] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:55 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:55.282501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:55.283206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:55.289577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:55.290057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:55.290544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:55.291178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:55.291636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:55.292077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:55.455658 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:55.456278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:55.463191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:55.463702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:55.464144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:55.464871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:55.465304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:55.465724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:55.533087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:55.541792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-630b7a12-7d6f-4b8c-a811-d1ebef3d2353 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.090594 Aug 22 19:44:55.542392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1111/2077] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:55 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:55.600965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:55.601638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:55.607552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:55.608070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:55.608503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:55.609192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:55.609643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:55.610533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:55.663142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:55.671823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b86fde31-d5ef-4d2d-9b45-fa5787c7b7c7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.393606 Aug 22 19:44:55.672404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 967/2078] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:55 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:55.740376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:55.748447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1dfe93d6-b042-4a55-bd8f-54ccbbbe8915 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151355 Aug 22 19:44:55.749015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1112/2079] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:55 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:56.209850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:56.210462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:56.216405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:56.216885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:56.217316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:56.218003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:56.219084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:56.219503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:56.344762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:56.353021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-52050902-d681-443e-9d7b-b2af2f10a7b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147818 Aug 22 19:44:56.353595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 968/2080] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:56 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:56.562272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:56.562943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:56.565296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:56.570741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:56.571225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:56.571688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:56.572387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:56.572853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:56.573265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:56.633659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:56.641711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c12f511a-70a0-40c0-bbc8-e668c447c308 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083298 Aug 22 19:44:56.642269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1113/2081] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:56 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:56.693755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:56.694369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:56.700482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:56.700962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:56.701399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:56.702085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:56.702535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:56.702956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:56.770018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:56.770639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:56.777800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:56.778290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:56.778731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:56.779456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:56.779936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:56.780363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:56.834254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:56.842885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f29dc836-fa3e-4fe3-83d8-fd945af085c9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152918 Aug 22 19:44:56.844151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 969/2082] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:56 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:56.913749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:56.922506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1314e0d3-43f1-404d-8c47-7c9cda58a4d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156453 Aug 22 19:44:56.923075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1114/2083] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:56 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:57.375150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:57.375795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:57.382253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:57.382683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:57.383125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:57.383853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:57.384315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:57.384743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:57.511784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:57.520005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-760dbfd7-fb61-4739-be10-6710541c6cda tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149292 Aug 22 19:44:57.520576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 970/2084] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:57 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:57.664177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:57.665047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:57.671408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:57.671923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:57.672358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:57.673037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:57.673484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:57.673909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:57.735122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:57.744082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b553b1cd-df7c-4790-9c6f-f779c5ad7c68 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084123 Aug 22 19:44:57.744650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1115/2085] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:57 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:57.864891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:57.865503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:57.871635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:57.872145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:57.872598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:57.873360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:57.873946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:57.874324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:57.943951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:57.944571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:57.950519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:57.951008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:57.951870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:57.952159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:57.953115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:57.953552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:58.010236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:58.019079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8006769-d8b8-471d-a196-9695c2a905d7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.158112 Aug 22 19:44:58.019704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 971/2086] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:57 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:58.083657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:58.092580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d07184ad-a151-4d78-be87-a5cfc2c00a73 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152559 Aug 22 19:44:58.093192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1116/2087] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:57 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:58.541372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:58.541984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:58.548101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:58.548605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:58.549055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:58.549715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:58.550164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:58.550589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:58.675657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:58.683754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7bf3e32-2a63-4692-8674-3b6ddd190070 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146228 Aug 22 19:44:58.684321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 972/2088] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:58 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:58.764552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:58.765738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:58.772147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:58.772624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:58.773054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:58.773732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:58.774180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:58.774595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:58.840211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:58.849097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-304ed24f-3d97-48c7-a179-ea751cf6b9b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088380 Aug 22 19:44:58.849667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1117/2089] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:58 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:59.040085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:59.040691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:59.047902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:59.048381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:59.048818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:59.049506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:59.049951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:59.050370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:59.113519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:59.114163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:59.120149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:59.120628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:59.121060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:59.121754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:59.122202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:59.122625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:59.183071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:59.191381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-daccfb32-50e9-45c2-9db6-edd7f99e722d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.155125 Aug 22 19:44:59.191979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 973/2090] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:59 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:59.252607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:59.260749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cd49ed38-288e-4d03-9efd-f7084635e66f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151364 Aug 22 19:44:59.261301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1118/2091] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:59 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:44:59.705765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:59.706423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:59.712819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:59.713296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:59.713728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:59.714443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:59.714888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:59.715305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:59.846451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:59.854518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37516a43-8779-4c7f-9d25-aa58f3fcb6f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153279 Aug 22 19:44:59.855077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 974/2092] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:59 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:44:59.869638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:44:59.870256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:44:59.877483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:59.877955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:59.878391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:59.879085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:44:59.879536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:44:59.879986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:44:59.940675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:44:59.942893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:59.950904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e39fb7f7-3988-4d92-a8a4-2830cc3aa083 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084926 Aug 22 19:44:59.951476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1119/2093] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:44:59 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:00.212477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:00.213096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:00.220232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:00.220712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:00.221148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:00.221836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:00.222289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:00.222714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:00.281296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:00.281910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:00.288008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:00.288503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:00.288943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:00.289639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:00.290094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:00.290523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:00.351710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:00.360487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e550065-952c-48f2-8cf8-fcb70605e442 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152065 Aug 22 19:45:00.361108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 975/2094] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:00 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:00.418563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:00.426923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-270ad57f-aa5c-4d53-af5f-eb8b3086a1d4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149530 Aug 22 19:45:00.427492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1120/2095] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:00 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:00.876755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:00.877366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:00.879313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:00.884411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:00.884885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:00.885315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:00.886001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:00.886447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:00.886866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:00.972339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:00.972961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:00.979392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:00.979909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:00.980348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:00.981042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:00.981494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:00.981915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:01.018647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:01.026973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-771db483-1b09-4b43-8504-cf8cdb2c4257 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154630 Aug 22 19:45:01.027559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 976/2096] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:00 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:01.043143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:01.052105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-95833ab4-1cd2-436f-8359-79dbbe3ea323 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084057 Aug 22 19:45:01.052690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1121/2097] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:00 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:01.383404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:01.384042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:01.390961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:01.391439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:01.391903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:01.392614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:01.393048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:01.393472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:01.448098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:01.448712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:01.455296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:01.455811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:01.456249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:01.456941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:01.457406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:01.457815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:01.520840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:01.529086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44e5adc2-9bb4-4e33-a96d-6383a30f0d88 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149500 Aug 22 19:45:01.529660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 977/2098] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:01 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:01.583493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:01.591900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7ecd1321-3289-4462-88ad-ea08d32cc26c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147549 Aug 22 19:45:01.592466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1122/2099] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:01 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:02.049245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:02.049787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:02.055805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:02.056290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:02.056728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:02.057420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:02.057873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:02.058298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:02.072340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:02.072956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:02.079528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:02.080039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:02.080479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:02.081169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:02.081619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:02.082044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:02.148585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:02.157342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1e228672-f7ef-412f-8580-eb39f4ee7fec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088783 Aug 22 19:45:02.158127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1123/2100] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:02 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:02.188938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:02.197024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1167b78-1062-4e40-80c7-8a1e7f59fd0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152338 Aug 22 19:45:02.197586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 978/2101] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:02 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:02.550668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:02.551341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:02.557756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:02.558241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:02.558675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:02.559360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:02.559845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:02.560273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:02.613380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:02.613986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:02.620339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:02.620818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:02.621251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:02.621937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:02.622383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:02.622801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:02.688569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:02.696907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-415f5373-96d7-4749-82be-56c55afdbf1f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150059 Aug 22 19:45:02.697682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1124/2102] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:02 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:02.758054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:02.760298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:02.768550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f482f152-9f98-48fe-931e-21ea9da1b20f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.158985 Aug 22 19:45:02.769161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 979/2103] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:02 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:03.176871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:03.177493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:03.183492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:03.184017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:03.184458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:03.185151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:03.185608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:03.186034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:03.219014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:03.219756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:03.225770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:03.226329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:03.226767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:03.227606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:03.227960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:03.228384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:03.247454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:03.256370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1c84bdd3-6e06-424a-8f86-df6d0373e092 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083441 Aug 22 19:45:03.257036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1125/2104] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:03 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:03.356970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:03.365382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9197eb5e-ab23-440e-8f81-65c75fc3daae tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150784 Aug 22 19:45:03.365956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 980/2105] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:03 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:03.719042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:03.719574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:03.725980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:03.726474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:03.726889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:03.727559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:03.728028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:03.728479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:03.789369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:03.789985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:03.796331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:03.797318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:03.797761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:03.798448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:03.798900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:03.799319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:03.860660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:03.872538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e249a8d6-5c4e-4ebc-8880-31fdbb0e534a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.156743 Aug 22 19:45:03.873350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1126/2106] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:03 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:03.933541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:03.942454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c49038b7-c03c-4134-a70f-5fce186b55ed tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156904 Aug 22 19:45:03.943029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 981/2107] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:03 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:04.277398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:04.278002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:04.284605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:04.285352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:04.285790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:04.286472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:04.286919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:04.287338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:04.348184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:04.356153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b63d535f-0864-4b3d-bfbc-ea53f516a464 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082806 Aug 22 19:45:04.356714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1127/2108] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:04 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:04.386265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:04.386884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:04.393389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:04.393878 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:04.394320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:04.395019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:04.395474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:04.395973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:04.522870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:04.531589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b2ec8af2-48d0-4804-95cc-8f4cab05b8f2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148553 Aug 22 19:45:04.532185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 982/2109] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:04 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:04.893645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:04.894258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:04.900783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:04.901260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:04.901690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:04.902368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:04.902814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:04.903234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:04.940996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:45:04.941303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:45:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:45:04.963687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:04.964295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:04.971121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:04.971602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:04.972058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:04.972757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:04.973211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:04.973635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:05.031324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:05.039966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-34c86c2c-8d0e-4e35-aabb-4c8a304cada8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150104 Aug 22 19:45:05.040630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1128/2110] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:04 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:05.104881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:05.113221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40819f70-6a3b-4c25-a2ae-91a44a0aafee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153717 Aug 22 19:45:05.113790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 983/2111] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:04 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:05.376494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:05.377106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:05.382911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:05.383394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:05.383872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:05.384569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:05.385078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:05.385524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:05.450273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:05.458866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a56cc4d8-a5c5-4eee-9868-75a3552e7e63 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086243 Aug 22 19:45:05.459431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1129/2112] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:05 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:05.552461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:05.553069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:05.558922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:05.559391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:05.559862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:05.560544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:05.560992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:05.561409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:05.687927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:05.696465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf519d6a-3760-4cff-ba49-da3d7f17fd40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147818 Aug 22 19:45:05.697033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 984/2113] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:05 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:06.061793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:06.062916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:06.069305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:06.069780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:06.070213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:06.070890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:06.071334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:06.071783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:06.134321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:06.135004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:06.141392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:06.142107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:06.142549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:06.143257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:06.143738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:06.144165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:06.199040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:06.208076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-79661da9-e376-45eb-b805-c463dfea1d86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150093 Aug 22 19:45:06.208670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1130/2114] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:06 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:06.274135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:06.282701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b8916e49-e0e2-4bec-a1a2-774d81f20190 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152241 Aug 22 19:45:06.283266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 985/2115] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:06 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:06.480718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:06.481371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:06.487858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:06.488344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:06.488809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:06.489497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:06.489955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:06.490383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:06.549989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:06.558011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-af68e875-ca51-4a5e-9af3-35c70028ea06 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081145 Aug 22 19:45:06.558580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1131/2116] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:06 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:06.717857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:06.719046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:06.725017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:06.725495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:06.725926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:06.726624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:06.727075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:06.727495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:06.857457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:06.866760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c725dea8-3a3a-49f4-80a7-f4c355de82d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152620 Aug 22 19:45:06.867335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 986/2117] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:06 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:07.230356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:07.230963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:07.237723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:07.238199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:07.238632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:07.239310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:07.239778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:07.240196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:07.304203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:07.305384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:07.311431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:07.311969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:07.312897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:07.313594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:07.314039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:07.314471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:07.373560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:07.382525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bec70965-5462-41f9-a7b7-501b755a9354 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.156136 Aug 22 19:45:07.383090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1132/2118] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:07 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:07.444958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:07.453555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d94e693-a586-4e8f-986d-be8aa5b63fbb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153938 Aug 22 19:45:07.454119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 987/2119] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:07 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:07.578271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:07.578882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:07.585152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:07.585628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:07.586059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:07.586735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:07.587180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:07.587598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:07.647032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:07.655174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-43d16207-dcce-4e74-9bc5-f2a6f6fe3be1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.080723 Aug 22 19:45:07.655771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1133/2120] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:07 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:07.887107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:07.887752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:07.893674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:07.894155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:07.894592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:07.895278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:07.895822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:07.896446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:08.027449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:08.036277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90c8715d-8a94-4044-9a67-84bf1a20742e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153064 Aug 22 19:45:08.036779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 988/2121] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:07 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:08.300014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:45:08.300211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:45:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:45:08.403908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:08.404524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:08.411849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:08.412374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:08.412768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:08.413746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:08.413936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:08.414359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:08.475608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:08.476238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:08.482778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:08.483258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:08.483740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:08.484436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:08.484882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:08.485301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:08.547837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:08.556128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7b90bf2c-26a7-4d3c-add6-d75b44295f20 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.156024 Aug 22 19:45:08.556636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1134/2122] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:08 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:08.614529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:08.622567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51073a74-b9de-4658-99b9-9a7c4076efe8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150909 Aug 22 19:45:08.623130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 989/2123] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:08 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:08.675519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:08.676171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:08.682139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:08.682619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:08.683057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:08.683777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:08.684234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:08.684662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:08.747661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:08.756322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9ca37b2c-8347-4d7a-a0fe-8a0f80cf106e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084711 Aug 22 19:45:08.756893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1135/2124] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:08 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:09.056681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:09.057292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:09.063722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:09.064200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:09.064631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:09.065316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:09.065758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:09.066176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:09.192826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:09.201043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f76e41d-c736-4d49-a50b-e4fde5582c39 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148255 Aug 22 19:45:09.201602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 990/2125] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:09 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:09.578450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:09.579089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:09.585726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:09.586199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:09.586627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:09.587304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:09.587777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:09.588197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:09.603406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:09.644301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:09.644938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:09.651217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:09.651733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:09.652168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:09.652897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:09.653346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:09.653771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:09.716167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:09.725210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c6186b1b-e562-41fa-a659-709d714127cb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151179 Aug 22 19:45:09.725969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1136/2126] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:09 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:09.778865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:09.779512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:09.786520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:09.786946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:09.787090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:09.787420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:09.788172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:09.788622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:09.789039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:09.795227 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42f5b8ce-4b88-4f65-818c-0c6a7de0c511 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155252 Aug 22 19:45:09.795814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 991/2127] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:09 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:09.849225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:09.857401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d671c9a4-5916-496b-aef0-ee7556015f41 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082410 Aug 22 19:45:09.857961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1137/2128] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:09 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:10.223260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:10.223904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:10.229849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:10.230328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:10.230761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:10.231443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:10.231915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:10.232338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:10.359270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:10.367496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5bcffaff-c03f-4f7f-9217-c7a84f81e56c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148178 Aug 22 19:45:10.368098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 992/2129] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:10 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:10.746342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:10.746950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:10.753912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:10.754388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:10.754816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:10.755492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:10.755973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:10.756393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:10.816923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:10.817456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:10.823938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:10.824596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:10.825096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:10.825802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:10.826254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:10.826731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:10.887370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:10.896385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dd49aaf6-a240-480c-ba48-f683f437bddb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153815 Aug 22 19:45:10.897150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1138/2130] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:10 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:10.901511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:10.902111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:10.907966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:10.908636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:10.908855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:10.911373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:10.911953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:10.912398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:10.961564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:10.969805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1b8a7f3-76e4-4434-a5b6-041628848e8c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.157414 Aug 22 19:45:10.970742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 993/2131] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:10 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:10.973704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:10.981973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6773f7d9-01a8-4767-981a-bade267fe01a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084020 Aug 22 19:45:10.983221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1139/2132] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:11.388365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:11.388976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:11.395392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:11.395948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:11.396334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:11.397015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:11.397461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:11.397877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:11.525010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:11.533131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f57ce77b-b0f7-4eae-91ea-48f8ef6930ef tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148635 Aug 22 19:45:11.533721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 994/2133] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:11 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:11.917477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:11.918115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:11.925350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:11.925830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:11.926305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:11.926981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:11.927458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:11.927909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:11.990903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:11.991678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:11.998340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:11.998834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:11.999277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:12.000638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:12.001097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:12.001524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:12.055137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:12.064152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9da4f577-9a4a-4473-a964-70488a351f66 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150483 Aug 22 19:45:12.064731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1140/2134] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:11 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:12.069167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:12.070203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:12.075594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:12.076098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:12.076557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:12.077241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:12.077717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:12.078160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:12.140688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:12.141772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:12.149362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7ecc287-a316-4088-a21d-17213cb736f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.162344 Aug 22 19:45:12.149962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a7268f61-f350-4507-b7cd-99b218fb3c1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084270 Aug 22 19:45:12.150101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 995/2135] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:11 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:12.150682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1141/2136] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:12 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:12.554026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:12.554673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:12.560647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:12.561126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:12.561562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:12.562763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:12.563218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:12.563657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:12.579032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:12.693265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:12.701442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-124170c0-278b-464f-9af2-ac6b51c40571 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151329 Aug 22 19:45:12.702007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 996/2137] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:12 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:13.085594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:13.086203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:13.092554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:13.093027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:13.094063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:13.094745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:13.095191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:13.095611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:13.170901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:13.172320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:13.178941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:13.179420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:13.179881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:13.180574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:13.181016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:13.181435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:13.225976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:13.235049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-03fcc489-436f-449a-bcc8-51c52dd61ffd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153567 Aug 22 19:45:13.235619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1142/2138] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:13.239985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:13.240824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:13.246434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:13.247166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:13.247688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:13.248452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:13.248976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:13.249504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:13.310235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:13.313321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:13.320384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a71fc317-e250-4140-aa1f-e4f3c269f8a0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083693 Aug 22 19:45:13.320962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1143/2139] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:13 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:13.321647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b24a9d2-9418-473a-80b7-0d1a0f212eb6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155031 Aug 22 19:45:13.322456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 997/2140] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:13.722963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:13.723582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:13.729581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:13.730064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:13.730501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:13.731188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:13.731654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:13.732089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:13.860395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:13.868451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b46c5cc3-3cff-4a87-bd72-c392afd2aabf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150057 Aug 22 19:45:13.869045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1144/2141] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:13 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:14.256780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:14.257528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:14.263972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:14.264458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:14.264896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:14.265586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:14.266037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:14.266459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:14.341424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:14.342146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:14.349183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:14.349727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:14.350205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:14.350856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:14.351310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:14.351755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:14.401366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:14.409811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90fe9bbb-512a-45f1-aab9-a70ba8802601 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.156890 Aug 22 19:45:14.410578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 998/2142] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:14.413961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:14.422681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4b5e4f2a-8c30-49ae-8d8a-7ce5311d782b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085449 Aug 22 19:45:14.423234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1145/2143] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:14.427960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:14.428570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:14.434645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:14.435154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:14.435589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:14.436300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:14.436749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:14.437770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:14.575381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:14.583454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d86e549d-4f4c-45af-afd1-9a2f57a997ef tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.159159 Aug 22 19:45:14.584133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 999/2144] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:14.888977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:14.889588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:14.895514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:14.896026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:14.896454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:14.897136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:14.897578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:14.897995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:15.021163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:15.029294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0defe7c4-e4d7-4e18-ae87-5bcd2edbd11a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.144256 Aug 22 19:45:15.029888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1146/2145] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:14 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:15.431951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:15.432596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:15.439534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:15.440113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:15.440563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:15.441269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:15.441724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:15.442187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:15.443673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:15.444291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:15.450608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:15.451084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:15.451515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:15.452251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:15.452890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:15.453309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:15.518845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:15.527541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7b97b887-bed3-47ea-865e-bd9e758aff3f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088173 Aug 22 19:45:15.535714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1147/2146] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:15.578336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:15.586663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a014cf8-3d90-4e49-a3b0-6f290d6fe3e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.158695 Aug 22 19:45:15.587229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1000/2147] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:15.605152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:15.605756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:15.611699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:15.612199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:15.612602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:15.613281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:15.613725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:15.614165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:15.739501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:15.748016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dd77ccf0-4436-4a29-ad81-caec0fb566c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146537 Aug 22 19:45:15.748583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1148/2148] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:15 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:16.050926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:16.051468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:16.057399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:16.057880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:16.058320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:16.059010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:16.059463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:16.059908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:16.187608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:16.195576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c685148a-6cf5-4710-a38d-2cd81837ee86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149090 Aug 22 19:45:16.196159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1001/2149] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:16 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:16.549202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:16.549849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:16.556290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:16.556776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:16.557216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:16.557904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:16.558357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:16.558842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:16.609834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:16.610542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:16.616991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:16.617663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:16.618127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:16.618896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:16.619424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:16.619874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:16.620045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:16.628691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-25fb1d16-f572-4610-b095-c79a31a5186b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083845 Aug 22 19:45:16.629274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1149/2150] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:16 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:16.748655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:16.756713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-967e0add-040a-4ce3-9a2e-070cdbee2ec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151227 Aug 22 19:45:16.757270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1002/2151] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:16.769132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:16.769745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:16.775555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:16.776069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:16.776506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:16.777192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:16.777640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:16.778063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:16.910095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:16.918174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-024f8f46-a46a-4ae5-9bcf-17cbaa3cc59d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152946 Aug 22 19:45:16.918734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1150/2152] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:16 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:17.217126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:17.217737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:17.224313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:17.224786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:17.225223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:17.225906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:17.226354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:17.226773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:17.356978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:17.365615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da56f6b0-7236-4ac9-ae76-9c6f22d0e66e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152315 Aug 22 19:45:17.366178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1003/2153] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:17 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:17.649818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:17.650422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:17.656836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:17.657313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:17.657741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:17.658419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:17.658877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:17.659280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:17.719165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:17.727354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cf3563c8-623b-4e91-86a2-adfc3d39e321 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081398 Aug 22 19:45:17.727940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1151/2154] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:17 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:17.780160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:17.780773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:17.787353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:17.787896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:17.788334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:17.789024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:17.789472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:17.789891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:17.917027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:17.925843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-428eef7a-b930-4b36-a1c1-8654c8a480db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149519 Aug 22 19:45:17.926407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1004/2155] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:17.940327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:17.940935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:17.946793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:17.947269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:17.947728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:17.948403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:17.948845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:17.949260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:18.073937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:18.081943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c066c282-c737-4d2f-b973-7fc2aef14599 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146096 Aug 22 19:45:18.082504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1152/2156] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:18.386101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:18.386722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:18.392888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:18.393370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:18.393805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:18.394497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:18.394948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:18.395369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:18.529227 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:18.537857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bde3939-359c-4bbd-b59a-99537448783e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.155584 Aug 22 19:45:18.538416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1005/2157] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:18 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:18.747982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:18.748597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:18.755028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:18.755515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:18.755990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:18.756685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:18.757138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:18.757566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:18.760110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:18.822363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:18.830961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6476a574-84c8-4f60-9cc0-eec49d7bbc56 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086883 Aug 22 19:45:18.831523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1153/2158] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:18 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:18.948062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:18.948667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:18.955852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:18.956336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:18.956770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:18.957454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:18.957904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:18.958325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:19.085263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:19.093358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30efa941-8754-4f59-843d-45b7a5c6f100 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149087 Aug 22 19:45:19.093926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1006/2159] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:19.103309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:19.103978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:19.109928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:19.110390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:19.110821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:19.111597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:19.112078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:19.112495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:19.236065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:19.244141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-242d17c8-1cc0-4349-acb9-f717397bc647 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.144589 Aug 22 19:45:19.244708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1154/2160] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:19 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:19.558963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:19.559564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:19.565549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:19.566021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:19.566451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:19.567126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:19.567569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:19.568008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:19.702219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:19.711535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b0dbdd7-3bf0-43d5-a3ed-071bd3b1391a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.156361 Aug 22 19:45:19.712125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1007/2161] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:19 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:19.852227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:19.852783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:19.859285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:19.859780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:19.860218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:19.860905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:19.861352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:19.861773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:19.921534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:19.929865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-da3f080c-86bd-497f-9691-2fe5227ebf54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081440 Aug 22 19:45:19.930442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1155/2162] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:20.115236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:20.115806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:20.122100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:20.122573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:20.122998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:20.123704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:20.124150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:20.124564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:20.252809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:20.261062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac367311-211e-430d-b6c8-bd71cff8783a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149704 Aug 22 19:45:20.261629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1008/2163] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:20 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:20.265316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:20.265939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:20.271894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:20.272375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:20.272808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:20.273495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:20.273947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:20.274370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:20.402501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:20.410818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9a4691be-a1a1-4587-86d2-d87a9f3a9408 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149315 Aug 22 19:45:20.411399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1156/2164] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:20 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:20.733857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:20.734560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:20.740567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:20.741043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:20.741472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:20.742182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:20.742645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:20.743056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:20.870367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:20.879216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8d6c59e-e0ce-4641-b4e1-4d609e536431 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149199 Aug 22 19:45:20.879810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1009/2165] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:20 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:20.951387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:20.952038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:20.958556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:20.959018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:20.959453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:20.960432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:20.960876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:20.961296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:21.021098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:21.029213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c5213854-fdbb-4086-a0c3-97d8d220918f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081657 Aug 22 19:45:21.029768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1157/2166] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:20 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:21.282668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:21.283215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:21.289716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:21.290210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:21.290632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:21.291319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:21.291801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:21.292224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:21.423116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:21.431536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e5ff3b1-9318-4fe7-8346-c4dcd201c95e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153348 Aug 22 19:45:21.432131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1010/2167] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:21.432782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:21.433406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:21.439526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:21.440049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:21.440578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:21.441263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:21.441716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:21.442142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:21.568215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:21.576264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2a18aa01-2c73-49f0-b231-5b72e775ba66 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147414 Aug 22 19:45:21.576834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1158/2168] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:21 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:21.900062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:21.900642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:21.907155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:21.907634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:21.908244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:21.908934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:21.909387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:21.909810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:22.036708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:22.044724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca65fab6-d149-4aa2-9188-ea94a603a2db tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148636 Aug 22 19:45:22.045286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1011/2169] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:21 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:22.049724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:22.050366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:22.056817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:22.057303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:22.057739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:22.058436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:22.058888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:22.059311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:22.123953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:22.132915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1166d046-1cd6-427a-b6dc-b36c3c92c5ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087091 Aug 22 19:45:22.133482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1159/2170] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:22 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:22.452762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:22.455061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:22.460202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:22.460686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:22.461120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:22.461813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:22.462267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:22.462691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:22.592981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:22.597503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:22.598154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:22.601859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9bd99032-319e-4f2c-95dc-9bcfc4d7c3ac tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152958 Aug 22 19:45:22.602431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1012/2171] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:22.604223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:22.604718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:22.605156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:22.605869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:22.606310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:22.606735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:22.730537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:22.738722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-25e772dc-f08b-4290-8001-db3fb53338dc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.145609 Aug 22 19:45:22.739285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1160/2172] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:22 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:23.066101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:23.066634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:23.072644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:23.073128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:23.073565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:23.074256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:23.074704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:23.075128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:23.078978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:23.154101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:23.154724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:23.161308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:23.161827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:23.162243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:23.162946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:23.163402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:23.163868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:23.206137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:23.214565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f732fba-1ac8-4090-847b-babbf010a48c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152926 Aug 22 19:45:23.215139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1013/2173] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:23 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:23.227040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:23.236229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3056c421-840d-471f-9cbf-e1cab7b5a657 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085871 Aug 22 19:45:23.236799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1161/2174] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:23 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:23.622388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:23.622953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:23.629234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:23.629708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:23.630140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:23.630819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:23.631269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:23.631704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:23.758217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:23.760128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:23.760751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:23.766466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31061b5f-e2a5-4918-91ed-ac5f4da27e6a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.147975 Aug 22 19:45:23.766715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:23.767032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1014/2175] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:23.767197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:23.767630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:23.768423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:23.768884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:23.769316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:24.114376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:24.122566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d52bfab3-52e8-49ec-8678-d0d7da25388a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.366286 Aug 22 19:45:24.123126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1162/2176] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:23 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:24.236186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:24.236797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:24.242654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:24.243130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:24.243557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:24.244266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:24.244711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:24.245129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:24.256790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:24.257433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:24.259816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:24.264949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:24.265431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:24.265869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:24.266562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:24.267014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:24.267440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:24.328682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:24.337198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a720bf81-f02e-4276-afab-1945845445f7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084187 Aug 22 19:45:24.337975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1163/2177] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:24.377685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:24.385913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ef55a1e-14cd-464f-bccf-617aedbf1c74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154228 Aug 22 19:45:24.386480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1015/2178] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:24 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:24.616158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:45:24.616481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:45:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:45:24.787977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:24.788594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:24.794714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:24.795190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:24.795620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:24.796320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:24.796763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:24.797178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:24.922981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:24.931132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c5fdb0cf-e3d5-4170-b8e7-04206320a86d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.146939 Aug 22 19:45:24.931710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1164/2179] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:25.144732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:25.145296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:25.151753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:25.152234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:25.152667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:25.153364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:25.153841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:25.154265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:25.279856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:25.287950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad7015d8-03e1-44ae-8821-5599dd37aaab tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147782 Aug 22 19:45:25.288499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1016/2180] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:25 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:25.358169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:25.358759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:25.365665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:25.366142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:25.366603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:25.367292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:25.367820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:25.368244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:25.406399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:25.406974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:25.412988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:25.413473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:25.413935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:25.414635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:25.415084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:25.415506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:25.431421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:25.440243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ac535949-607d-44db-b340-e9c0eb6d5668 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085896 Aug 22 19:45:25.440814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1165/2181] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:25 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:25.548532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:25.556630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3d41ed1-3743-4bd2-bcd2-cd48ad6ab41c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154137 Aug 22 19:45:25.557233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1017/2182] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:25 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:25.952967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:25.953577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:25.959529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:25.960299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:25.960726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:25.961401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:25.961854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:25.962271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:26.088310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:26.097090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b9780cce-ef40-437e-8b85-9efa45d9680d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.147981 Aug 22 19:45:26.097657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1166/2183] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:25 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:26.309531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:26.310075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:26.316467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:26.316938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:26.317364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:26.318043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:26.318497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:26.318910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:26.445605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:26.453701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d6c78bb4-3816-4ac0-8721-68863e2deda5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148094 Aug 22 19:45:26.454890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1018/2184] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:26 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:26.461553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:26.462200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:26.468563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:26.469045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:26.469484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:26.470205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:26.470659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:26.471088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:26.532018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:26.540155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c053dcb1-1625-49fa-afc4-24d159860f70 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082718 Aug 22 19:45:26.540718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1167/2185] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:26 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:26.577837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:26.578366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:26.585154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:26.585667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:26.586098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:26.586783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:26.587234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:26.587747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:26.717380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:26.725502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dfb6c508-d9de-45b1-a7d9-bac1dc08d5cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151562 Aug 22 19:45:26.726070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1019/2186] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:26 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:27.118400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:27.118971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:27.125002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:27.125481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:27.126565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:27.127258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:27.127738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:27.128162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:27.264544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:27.272640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-885b3408-a870-40fa-bdbe-f4f6eb78e0d6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.158194 Aug 22 19:45:27.273182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1168/2187] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:27.476210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:27.476824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:27.483199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:27.483708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:27.484146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:27.484838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:27.485987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:27.486419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:27.560985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:27.561596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:27.567980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:27.568455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:27.568887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:27.569571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:27.570019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:27.570436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:27.614531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:27.622627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6f8d756-0505-4f85-bf80-045dfbaccbd3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150220 Aug 22 19:45:27.623197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1020/2188] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:27 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:27.632456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:27.634768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:27.642670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b8efe10f-924a-4e21-b7c8-e39d50af14bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085435 Aug 22 19:45:27.643234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1169/2189] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:27.746485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:27.747017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:27.752940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:27.753412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:27.753843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:27.754521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:27.754968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:27.755386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:27.884925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:27.893582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-336d06fd-d775-4428-a29a-2adddc451931 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151165 Aug 22 19:45:27.894135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1021/2190] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:27 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:28.294103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:28.294708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:28.301555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:28.302034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:28.302465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:28.303149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:28.303592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:28.304058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:28.427760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:28.435831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7bdf9ae1-901e-4f14-8f97-eae3ad338597 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.145564 Aug 22 19:45:28.436402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1170/2191] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:28.643944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:28.644539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:28.650791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:28.651269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:28.651720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:28.652492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:28.652941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:28.653358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:28.662673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:28.663290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:28.669651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:28.670133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:28.670569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:28.671679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:28.671831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:28.672140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:28.736667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:28.745338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0d0d9a12-8718-454c-99ed-e95d60ee3ad2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086436 Aug 22 19:45:28.746535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1171/2192] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:28 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:28.787765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:28.796038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75061cc3-2cc9-4b6f-a938-4b6fd78d14f9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156583 Aug 22 19:45:28.796602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1022/2193] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:28 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:28.914321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:28.914936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:28.920926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:28.921402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:28.921834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:28.922516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:28.922973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:28.923394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:29.046008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:29.054941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7873d6fc-fb84-42e9-8582-7ea52caa4af5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.144434 Aug 22 19:45:29.055528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1172/2194] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:28 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:29.457431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:29.458059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:29.464365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:29.464841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:29.465272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:29.465953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:29.466398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:29.466818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:29.592881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:29.601626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01e85023-2fa8-456f-ae99-4b341e962e89 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148188 Aug 22 19:45:29.602196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1023/2195] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:29.767307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:29.767951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:29.774737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:29.775210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:29.775637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:29.776353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:29.776799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:29.777215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:29.816724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:29.817339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:29.823757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:29.824243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:29.824678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:29.825375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:29.825826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:29.826248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:29.839475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:29.848313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bc16ec1f-febf-433c-89a3-d96302b79db6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084752 Aug 22 19:45:29.848823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1173/2196] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:29 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:29.956728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:29.965378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff2a33b9-9bb4-4235-9dfd-98f8e38747d9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152425 Aug 22 19:45:29.965952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1024/2197] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:29 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:30.078252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:30.078892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:30.085506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:30.085983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:30.086411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:30.087085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:30.087530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:30.087976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:30.220502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:30.228556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8533eb10-7412-4e08-85e7-0c126dedebf5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154137 Aug 22 19:45:30.229119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1174/2198] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:30 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:30.623437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:30.624079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:30.629959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:30.630433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:30.630863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:30.631544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:30.632016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:30.632428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:30.759838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:30.768543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92824937-1032-47dc-a60b-0b3a533e0c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148920 Aug 22 19:45:30.769098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1025/2199] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:30 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:30.867782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:30.868397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:30.874839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:30.875266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:30.875738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:30.876423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:30.876872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:30.877297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:30.937585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:30.946117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a9917d9e-adb3-42f4-b1c5-5e09293e7840 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082183 Aug 22 19:45:30.946676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1175/2200] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:30.986971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:30.987586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:30.989880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:30.995071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:30.995557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:30.996024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:30.996727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:30.997185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:30.997615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:31.124428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:31.133315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e79b6a3c-9fd9-4855-964e-868a5b333474 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149923 Aug 22 19:45:31.133820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1026/2201] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:30 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:31.248861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:31.249506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:31.255969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:31.256446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:31.256878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:31.257559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:31.258010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:31.258428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:31.384518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:31.392537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-76896985-134f-4033-a06b-7e6180786f7c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147485 Aug 22 19:45:31.393102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1176/2202] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:31 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:31.789840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:31.790818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:31.796489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:31.796963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:31.797391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:31.798736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:31.799177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:31.799592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:31.929705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:31.937726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25c25ddc-e314-4f08-ba14-f2e472d7e150 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151775 Aug 22 19:45:31.938303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1027/2203] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:31.967316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:31.967951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:31.974345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:31.974822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:31.975258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:31.976010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:31.976656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:31.977085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:32.041552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:32.050177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c6d8306f-5f02-4e59-9e3f-da6c6e88adaa tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086657 Aug 22 19:45:32.050752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1177/2204] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:32.156585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:32.158293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:32.165859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:32.166349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:32.166783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:32.167474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:32.167957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:32.168381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:32.295586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:32.303673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b17bd4fb-281c-4556-a839-367ba7a882fd tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152380 Aug 22 19:45:32.304234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1028/2205] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:32 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:32.413018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:32.413665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:32.420123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:32.420599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:32.421032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:32.421712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:32.422159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:32.422580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:32.549346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:32.557415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-55005c17-531a-410b-a42b-f1d0e27aeea1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148241 Aug 22 19:45:32.557975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1178/2206] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:32 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:32.959283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:32.960181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:32.966188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:32.966667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:32.967099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:32.967823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:32.968272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:32.968691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:33.069830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:33.070442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:33.076410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:33.076911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:33.077332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:33.078031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:33.078483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:33.078906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:33.099326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:33.101529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:33.108954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be68292a-dffe-4ffa-a856-fa8688c8f812 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154143 Aug 22 19:45:33.109531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1029/2207] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:33.141142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:33.149875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3235d443-9914-4674-8c98-50384b92a81a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083902 Aug 22 19:45:33.150448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1179/2208] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:33 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:33.324237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:33.324818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:33.331626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:33.332129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:33.332556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:33.333243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:33.333694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:33.334111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:33.462365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:33.470883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22897a06-6bed-4b04-be5f-c8e06dfbf6b1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150551 Aug 22 19:45:33.471448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1030/2209] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:33 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:33.578200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:33.578729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:33.585405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:33.585878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:33.586310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:33.586982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:33.587423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:33.587871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:33.716760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:33.725592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2745660f-4174-43d9-b158-ebb2239c9c75 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151301 Aug 22 19:45:33.726189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1180/2210] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:33 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:34.130445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:34.131059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:34.137144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:34.137629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:34.138069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:34.138765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:34.139216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:34.139676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:34.170192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:34.170877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:34.176766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:34.177259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:34.177675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:34.178358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:34.178802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:34.179220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:34.240454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:34.249080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9fae269f-fadf-47a3-ab58-65f19c075473 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082659 Aug 22 19:45:34.249660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1181/2211] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:34.270064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:34.278189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e202692d-34f7-46ca-95e0-6dc0798bff7c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152124 Aug 22 19:45:34.278745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1031/2212] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:34.492342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:34.492952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:34.499139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:34.499611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:34.500069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:34.500744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:34.501186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:34.501605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:34.628823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:34.636801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-40b091ce-789f-4fe5-8e1e-f5f0ee529bf5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148296 Aug 22 19:45:34.637396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1182/2213] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:34 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:34.746344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:34.746903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:34.753910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:34.754393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:34.754832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:34.755527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:34.756004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:34.756422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:34.886529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:34.894632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a44d6383-9cf2-476c-b9b1-863b4119af79 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152283 Aug 22 19:45:34.895201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1032/2214] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:34 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:35.270168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:35.270775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:35.276847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:35.277324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:35.277811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:35.278451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:35.278894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:35.279314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:35.298321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:35.299554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:35.305396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:35.305880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:35.306319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:35.307007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:35.307452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:35.307913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:35.346767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:35.354965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6838aab3-fef3-435c-9f17-49944532e7b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088558 Aug 22 19:45:35.355540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1183/2215] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:35 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:35.440206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:35.448274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b166f943-3611-4880-9a2b-8c818cdc6429 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.153800 Aug 22 19:45:35.448846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1033/2216] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:35.658219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:35.659251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:35.665881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:35.666357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:35.666786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:35.667496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:35.667961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:35.668378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:35.794848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:35.805478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-16753ac8-8d50-4852-89e1-9bde3ca8a27c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151211 Aug 22 19:45:35.806061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1184/2217] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:35 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:35.916063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:35.916586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:35.922963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:35.923442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:35.923919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:35.924609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:35.925061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:35.925485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:36.056079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:36.064317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd4246c0-67d1-44ff-9d62-67102c08710a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152093 Aug 22 19:45:36.064882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1034/2218] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:35 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:36.376220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:36.376809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:36.382806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:36.383280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:36.383736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:36.384416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:36.384861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:36.385292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:36.445885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:36.453886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0f338568-0a36-4dde-a3f7-f7ea16e65447 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081583 Aug 22 19:45:36.454455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1185/2219] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:36.469515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:36.470123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:36.477035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:36.477511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:36.477946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:36.478626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:36.479072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:36.479488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:36.607092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:36.615130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-617692ae-2ccf-4ccb-a597-e593154c6279 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.149383 Aug 22 19:45:36.615703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1035/2220] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:36.826447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:36.826983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:36.833427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:36.833908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:36.834344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:36.835294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:36.835773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:36.836203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:36.850815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:36.967226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:36.975480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cd33c181-13ab-41ff-8081-05427b3981c9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152969 Aug 22 19:45:36.976081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1186/2221] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:36 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:37.084496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:37.085296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:37.092035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:37.092544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:37.092980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:37.093668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:37.094118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:37.094539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:37.226166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:37.234269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-27fc7153-eec5-45da-bdc5-fac49f4a07d1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154267 Aug 22 19:45:37.234841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1036/2222] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:37 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:37.474352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:37.474950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:37.480838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:37.481314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:37.481741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:37.482447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:37.482892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:37.483307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:37.542983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:37.551548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-28a3969c-0eb4-4556-96aa-d4216608b1f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081106 Aug 22 19:45:37.552132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1187/2223] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:37.635872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:37.636490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:37.642397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:37.642871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:37.643301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:37.644008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:37.644459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:37.644877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:37.772571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:37.780608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dda1ff53-c649-4299-9d61-6f82161a3be0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.148554 Aug 22 19:45:37.781168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1037/2224] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:37 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:37.996639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:37.997180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:38.003677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:38.004161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:38.004597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:38.005288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:38.005740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:38.006167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:38.130930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:38.139024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6be31c62-17d7-41a3-a13d-0cc69a33560e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146741 Aug 22 19:45:38.139591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1188/2225] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:37 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:38.254913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:38.255456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:38.261875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:38.262388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:38.262849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:38.263555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:38.264036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:38.264453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:38.391259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:38.400291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae4f7175-7c62-4ef3-8b69-a12bc61a1e4c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149327 Aug 22 19:45:38.400856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1038/2226] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:38 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:38.572533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:38.573071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:38.578966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:38.579449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:38.579922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:38.580609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:38.581748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:38.582176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:38.645168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:38.653344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c5c65ea9-af24-42dd-99ca-4f459ebcb15a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084722 Aug 22 19:45:38.653910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1189/2227] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:38.803020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:38.803630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:38.809697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:38.810181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:38.810620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:38.811307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:38.811791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:38.812222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:38.944849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:38.952981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff5b6778-4e51-4fa9-9c53-cd9c69adb76e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.154317 Aug 22 19:45:38.953545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1039/2228] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:39.162318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:39.162930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:39.169411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:39.169924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:39.170361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:39.171047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:39.171495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:39.171944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:39.297512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:39.306203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dfa06ca4-6f20-46ca-beb9-a2b0a8509c0e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147737 Aug 22 19:45:39.306762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1190/2229] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:39 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:39.421017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:39.421558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:39.428532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:39.429004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:39.429433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:39.430115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:39.430558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:39.430973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:39.564545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:39.572658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-565dd024-d6af-4e8c-92a4-9ccfab22efe3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.155564 Aug 22 19:45:39.573256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1040/2230] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:39 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:39.673926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:39.674453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:39.680508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:39.680988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:39.681426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:39.682118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:39.682568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:39.682991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:39.744998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:39.753053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-742efc92-d335-437f-a792-42d7fb55658e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083014 Aug 22 19:45:39.753617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1191/2231] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:39 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:39.974123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:39.974774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:39.981100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:39.981574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:39.982005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:39.982685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:39.983127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:39.983540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:40.114388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:40.122515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3061cd0c-9c5c-4659-970c-6c583eff6d70 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.152165 Aug 22 19:45:40.123068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1041/2232] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:40.327157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:40.327722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:40.334153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:40.334629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:40.335328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:40.336039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:40.336491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:40.336912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:40.469742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:40.477803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1eaf2378-124d-4955-9b85-20faaa07d433 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154582 Aug 22 19:45:40.478378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1192/2233] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:40 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:40.594106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:40.594668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:40.601103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:40.601579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:40.602005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:40.602686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:40.603132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:40.603576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:40.731502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:40.742053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be173bf7-b412-4b10-bcf0-cc9a24045f2b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151763 Aug 22 19:45:40.742695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1042/2234] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:40 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:40.773258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:40.773874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:40.779845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:40.780330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:40.780773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:40.781460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:40.781914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:40.782340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:40.844849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:40.853448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ce324f50-4f73-498a-881c-a19f4bc8e953 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083961 Aug 22 19:45:40.854015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1193/2235] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:41.144446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:41.144987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:41.150970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:41.151447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:41.151910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:41.152595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:41.153040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:41.153457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:41.282272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:41.290997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39ed53a3-fafb-4f4c-822f-1270837461d2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.150959 Aug 22 19:45:41.291559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1043/2236] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:41 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:41.499062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:41.499701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:41.506595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:41.507070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:41.507504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:41.508211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:41.508656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:41.509072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:41.633699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:41.641745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4c7d028c-3b69-4d60-b11f-dd9294ebc107 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146533 Aug 22 19:45:41.642653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1194/2237] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:41 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:41.762399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:41.762957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:41.769350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:41.769830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:41.770272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:41.771015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:41.771419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:41.771854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:41.903822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:41.911818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-538f07d7-d808-46d1-8c9f-f4aec0612a3b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153350 Aug 22 19:45:41.912376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1044/2238] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:41 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:41.971542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:41.972185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:41.978752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:41.979245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:41.979701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:41.980394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:41.980846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:41.981277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:42.046512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:42.054604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-29c24b05-fa75-413a-9e93-43a7765c97bb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.184200 Aug 22 19:45:42.055170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1195/2239] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:42.312112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:42.312724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:42.319170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:42.319673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:42.320107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:42.320800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:42.321253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:42.321706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:42.536458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:42.544687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ef1f597-209a-4d20-97e1-1aecdb5954e3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.236431 Aug 22 19:45:42.545263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1045/2240] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:42.663474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:42.664131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:42.670425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:42.670901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:42.671372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:42.672071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:42.672516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:42.672934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:42.802391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:42.812107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-373609d9-851e-4664-9947-6eeccc894417 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152420 Aug 22 19:45:42.812686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1196/2241] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:42.932826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:42.934067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:42.940331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:42.940808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:42.941239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:42.941927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:42.942367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:42.943071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:42.957708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:43.075438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:43.076147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:43.079084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:43.082899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:43.083447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:43.084064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:43.084769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:43.085635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:43.085971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:43.088525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60e7795a-37e3-4ffa-a315-0d9551cd58ce tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.159420 Aug 22 19:45:43.089174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1046/2242] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:42 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:43.146779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:43.155049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-304acf29-e140-4084-8288-cc83521f0174 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084012 Aug 22 19:45:43.155611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1197/2243] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:43.565800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:43.566417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:43.572390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:43.572868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:43.573301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:43.574016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:43.574465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:43.574885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:43.714296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:43.722630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73a905ba-3bcb-41ed-942c-cb3599aa7c75 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.160610 Aug 22 19:45:43.723194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1047/2244] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:43 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:43.833509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:43.834119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:43.840727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:43.841202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:43.841634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:43.842312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:43.842757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:43.843175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:43.970939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:43.979086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3a058a38-ca9b-4b5a-869e-3b453b5f8fb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150163 Aug 22 19:45:43.979666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1198/2245] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:43 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:44.110116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:44.110695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:44.117599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:44.118081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:44.118517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:44.119210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:44.119681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:44.120112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:44.176527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:44.177644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:44.184317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:44.184809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:44.185249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:44.185965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:44.186419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:44.186843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:44.252941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:44.262198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3abf4696-dab1-4571-8798-1671984763ef tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.089461 Aug 22 19:45:44.262888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1199/2246] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:44 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:44.400816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:44.408906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c318f164-ffc8-42ad-b4f8-7efc9e82b1dd tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.302740 Aug 22 19:45:44.409459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1048/2247] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:44 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:44.744623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:44.745239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:44.751099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:44.751735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:44.752168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:44.752870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:44.753322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:44.753746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:44.884255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:44.892569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-72a74260-c0b1-49b9-ae62-1a32cef6cd99 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1727 microversion: 2.1 time: 0.151850 Aug 22 19:45:44.893257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1200/2248] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:44 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:45.000141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:45.000799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:45.007278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:45.007806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:45.008222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:45.008939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:45.009383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:45.009799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:45.251342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:45.259827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67f2ee53-c372-47b2-977a-4d3eed3f9d1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.263738 Aug 22 19:45:45.260391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1049/2249] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:44 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:45.282122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:45.282713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:45.289238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:45.289712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:45.290144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:45.290832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:45.291279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:45.291718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:45.356063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:45.364412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-463e66a9-554b-4990-9eca-42b1a9a28b4d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086021 Aug 22 19:45:45.366260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1201/2250] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:45 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:45.434051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-bb48d3cd-6ac8-4537-94e2-e20d4a018bfd req-6605a59d-7bd5-4eef-9d50-945c4bc7f62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b95c1a3-7046-4ae9-aec5-fb8838e1d45e", "name": "network-vif-deleted", "tag": "9c89ecbc-8920-445b-bd9b-563d448b3243"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:45:45.435309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:45.435987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:45.449862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:45.450683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:45.452190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:45.453551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:45.456181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:45.456864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:45.460339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bb48d3cd-6ac8-4537-94e2-e20d4a018bfd req-6605a59d-7bd5-4eef-9d50-945c4bc7f62d service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:45.465515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bb48d3cd-6ac8-4537-94e2-e20d4a018bfd req-6605a59d-7bd5-4eef-9d50-945c4bc7f62d service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:45.466246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-bb48d3cd-6ac8-4537-94e2-e20d4a018bfd req-6605a59d-7bd5-4eef-9d50-945c4bc7f62d service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:45.483564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-bb48d3cd-6ac8-4537-94e2-e20d4a018bfd req-6605a59d-7bd5-4eef-9d50-945c4bc7f62d service nova] Creating event network-vif-deleted:9c89ecbc-8920-445b-bd9b-563d448b3243 for instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e on hv-cinder-83538 Aug 22 19:45:45.493715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-bb48d3cd-6ac8-4537-94e2-e20d4a018bfd req-6605a59d-7bd5-4eef-9d50-945c4bc7f62d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067640 Aug 22 19:45:45.494466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1050/2251] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:45:45.630699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:45.638979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a3c2f039-b530-4063-9764-90b82f0cca41 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.210058 Aug 22 19:45:45.639558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1202/2252] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:45 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:45.915364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:45.916415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:45.922612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:45.923096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:45.923607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:45.924456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:45.924910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:45.925332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:45.988333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:45.996567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b07fc82-9334-4c98-a2fd-55d6da0235a3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085810 Aug 22 19:45:45.997127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1051/2253] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:45 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:46.280754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:46.281361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:46.287998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:46.288584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:46.288896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:46.289582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:46.290034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:46.290452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:46.293319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:46.387922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:46.389143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:46.395053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:46.395775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:46.396264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:46.397152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:46.397796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:46.398349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:46.426293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:46.436239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0dcd7c02-920d-4f4b-a921-39f87985ed4c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.159300 Aug 22 19:45:46.436823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1203/2254] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:46 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:46.462574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:46.471029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-907552a1-aa9a-4676-b3f4-6e45d8da80c7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088058 Aug 22 19:45:46.471588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1052/2255] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:46.662764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:46.663464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:46.669604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:46.670084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:46.670519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:46.671213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:46.671864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:46.672096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:46.814981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:46.823227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b21b0086-3cf5-4a3d-a143-10527b38b56a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.165982 Aug 22 19:45:46.823834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1204/2256] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:46 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:47.018162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:47.018819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:47.025276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:47.025757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:47.026184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:47.026862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:47.027308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:47.027755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:47.087384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:47.095445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ced751a-5b1e-4d09-a610-443d65dc32e1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081189 Aug 22 19:45:47.096062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1053/2257] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:47 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:47.459037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:47.459690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:47.466371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:47.466844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:47.467271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:47.467975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:47.468422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:47.468838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:47.492200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:47.492823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:47.499159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:47.499672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:47.500109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:47.500797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:47.501245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:47.501670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:47.567133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:47.575885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-14f3d56b-4d82-4213-a93f-6114ad7651f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087344 Aug 22 19:45:47.576843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1054/2258] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:47.596116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:47.604209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b0336fe3-b596-4759-a745-7228d5d340d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149944 Aug 22 19:45:47.604765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1205/2259] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:47 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:47.844845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:47.845268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:47.851466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:47.851987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:47.852426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:47.853125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:47.853578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:47.853997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:47.980294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:47.988400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a918bf5f-f239-443e-b276-c605cf2dad2f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147606 Aug 22 19:45:47.988956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1055/2260] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:47 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:48.116159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:48.116693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:48.122677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:48.123156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:48.123594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:48.124433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:48.124758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:48.125178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:48.185123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:48.193794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c4d86b5a-2731-4adf-9ec5-76ec34f67bfb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081581 Aug 22 19:45:48.194365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1206/2261] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:48 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:48.596810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:48.597419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:48.604437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:48.604915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:48.605349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:48.606037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:48.606494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:48.606918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:48.624445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:48.625076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:48.631778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:48.632257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:48.632689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:48.633378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:48.633823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:48.634241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:48.667510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:48.675862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5230d637-fe78-4cb3-a49d-01335609e4c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082813 Aug 22 19:45:48.676421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1056/2262] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:48.766262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:48.775041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4f2d955d-c9f4-49b4-a811-9edd0c4d1d4a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154362 Aug 22 19:45:48.775609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1207/2263] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:48 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:49.010238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:49.010841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:49.016834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:49.017254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:49.017682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:49.018356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:49.018801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:49.019216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:49.147470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:49.155456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-460f786f-c019-4087-9680-5944096ae450 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149062 Aug 22 19:45:49.156040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1057/2264] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:49 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:49.214921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:49.215529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:49.221610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:49.222084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:49.222515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:49.223193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:49.223661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:49.224698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:49.284672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:49.293312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2d66c052-1261-440f-b6cc-6cae5368f88b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082165 Aug 22 19:45:49.293873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1208/2265] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:49 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:49.697099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:49.697689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:49.704209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:49.704837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:49.705268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:49.706072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:49.706525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:49.706999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:49.769562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:49.778340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9110fb79-384f-4ca8-8cfe-155b0c4f71ce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085603 Aug 22 19:45:49.778888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1058/2266] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:49.796605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:49.797249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:49.803793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:49.804275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:49.804711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:49.805392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:49.805842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:49.806263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:49.939502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:49.947678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6fe7e786-4e7c-4dc5-b686-408802000c0f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154840 Aug 22 19:45:49.948196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1209/2267] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:49 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:50.176054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:50.176658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:50.182532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:50.182991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:50.183550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:50.184372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:50.184825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:50.185244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:50.309977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:50.313994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:50.314967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:50.318978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cc2c038c-810e-4889-95cf-f9793ba2e61e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146725 Aug 22 19:45:50.319759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1059/2268] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:50 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:50.321519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:50.322005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:50.322441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:50.323133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:50.323584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:50.324034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:50.384749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:50.392894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5e071198-e48a-4764-a681-cc4ebb9cd78f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082791 Aug 22 19:45:50.393465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1210/2269] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:50 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:50.798790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:50.799383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:50.807419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:50.807948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:50.808393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:50.809099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:50.809592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:50.810019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:50.969884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:50.970618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:50.977638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:50.978132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:50.978575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:50.979285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:50.979770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:50.980242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:51.109212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:51.112704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:51.118355 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-621e2589-740c-4311-9594-890673241742 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.323342 Aug 22 19:45:51.118931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1060/2270] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:50 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:51.121413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ab35e2e0-a9f2-4d1d-8138-46787c558a86 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155427 Aug 22 19:45:51.121990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1211/2271] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:50 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:51.340668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:51.341206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:51.347092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:51.347572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:51.348036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:51.348725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:51.349176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:51.349598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:51.414255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:51.414875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:51.420868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:51.421344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:51.421774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:51.422456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:51.422900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:51.423316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:51.477469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:51.484680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:51.486280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a42ace6-6dfe-4bea-a3ae-dc75c74aec6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149472 Aug 22 19:45:51.486858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1061/2272] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:51 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:51.493393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0548b877-cf02-49fc-adcd-5c2e603e2071 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083032 Aug 22 19:45:51.493954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1212/2273] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:51 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:52.139549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:52.141061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:52.142212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:52.143005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:52.145175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:52.149055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:52.149737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:52.150212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:52.150944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:52.151398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:52.151531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:52.151856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:52.151976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:52.152341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:52.153052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:52.153477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:52.153893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:52.216684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:52.226130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2cf41369-b66d-464e-881f-d9bafb925679 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.090378 Aug 22 19:45:52.226706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1062/2274] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:52.284253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:52.292341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7ccdec5c-6922-467e-9019-9e4c7974322a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154100 Aug 22 19:45:52.292909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1213/2275] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:52 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:52.508320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:52.508929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:52.514112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:52.514730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:52.514883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:52.515362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:52.515822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:52.516512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:52.516955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:52.517379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:52.520650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:52.521128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:52.521565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:52.522579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:52.522713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:52.523121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:52.584392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:52.592992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b1bfea3-2a39-4485-9ed6-d3cbb2a7231d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082666 Aug 22 19:45:52.593569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1214/2276] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:52 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:52.649815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:52.652138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:52.659429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a6a5a7ff-f444-4eda-8933-1e125e0bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.155582 Aug 22 19:45:52.660034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1063/2277] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:52 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:53.247081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:53.247751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:53.254308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:53.254799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:53.255233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:53.255964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:53.256420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:53.256847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:53.313897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:53.314659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:53.319973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:53.321870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:53.322356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:53.322994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:53.323789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:53.324457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:53.325024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:53.328248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2b7fd00c-c56a-47f8-ad07-bba85e6d0e15 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085117 Aug 22 19:45:53.329135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1215/2278] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:53.455258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:53.463864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-386c0db6-8aac-4876-8d8e-7a86193aa2c1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153780 Aug 22 19:45:53.464439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1064/2279] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:53 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:53.614344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:53.615462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:53.621386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:53.621868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:53.622292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:53.622963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:53.623405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:53.623866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:53.681283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:53.681934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:53.686284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:53.688156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:53.688646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:53.689161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:53.689863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:53.690316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:53.690739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:53.694412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-20b9a95e-1719-444f-a31d-fbfd1e494011 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084118 Aug 22 19:45:53.694985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1216/2280] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:53 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:53.821123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:53.829234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dcedbb95-29f5-4af2-91d3-383801bb0fba tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152447 Aug 22 19:45:53.829794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1065/2281] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:53 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:54.350223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:54.350832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:54.357356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:54.357834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:54.358271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:54.358962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:54.359419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:54.359868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:54.420570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:54.428966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5545310b-4cb9-479a-83a2-38c1f7b08fe8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082628 Aug 22 19:45:54.429546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1217/2282] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:54.485907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:54.486551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:54.493475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:54.493953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:54.494393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:54.495080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:54.495530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:54.495980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:54.623047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:54.631738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-705b02a7-5f47-4624-a704-a03f7b9fffd5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149666 Aug 22 19:45:54.632293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1066/2283] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:54 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:54.715365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:54.716003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:54.721874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:54.722403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:54.722834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:54.723513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:54.724010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:54.724432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:54.784570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:54.792519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8f26423e-b380-4d80-ab0d-cb6f4a01f776 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081064 Aug 22 19:45:54.793087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1218/2284] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:54 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:54.851003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:54.851876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:54.857798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:54.858283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:54.858722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:54.859415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:54.859900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:54.860331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:54.988205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:54.996375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78e6026b-3499-4f76-b95c-86057b3bdef7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149652 Aug 22 19:45:54.996950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1067/2285] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:54 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:55.449986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:55.450596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:55.457384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:55.457878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:55.458369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:55.459102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:55.459553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:55.460300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:55.521996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:55.524166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:45:55.531255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-23b12db0-144d-480e-9630-ee8c7c5fe085 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085142 Aug 22 19:45:55.531847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1219/2286] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:55 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:55.652426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:55.653066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:55.659839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:55.660315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:55.660889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:55.662082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:55.662526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:55.662943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:55.793583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:55.801710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a5b5466-d6bf-4ec1-b03f-83bc650091e2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153075 Aug 22 19:45:55.802910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1068/2287] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:55 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:55.813315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:55.813924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:55.820031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:55.820505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:55.820938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:55.821613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:55.822059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:55.822478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:55.882123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:55.890269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-042b4197-40b4-48a8-be43-ddd21c63fa9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.080720 Aug 22 19:45:55.890838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1220/2288] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:55 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:56.016798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:56.017330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:56.023768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:56.024245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:56.024675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:56.025356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:56.025803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:56.026221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:56.163808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:56.171846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0b34b37-fa8e-4b10-8d07-13c6814414cf tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.158902 Aug 22 19:45:56.172436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1069/2289] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:56 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:56.551973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:56.552517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:56.558898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:56.559382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:56.559851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:56.560535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:56.560986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:56.561408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:56.624249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:56.632803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f757fe32-9eec-4ef8-ba56-d33774b3180f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084813 Aug 22 19:45:56.633372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1221/2290] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:56 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:56.823862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:56.824393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:56.830821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:56.831309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:56.831774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:56.832468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:56.832924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:56.833862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:56.910398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:56.911059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:56.917834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:56.918311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:56.918805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:56.919497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:56.919972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:56.920392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:56.966375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:56.975502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69da3b97-ac86-487d-a4c2-274b4ef59f61 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155582 Aug 22 19:45:56.976107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1070/2291] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:56 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:56.981545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:56.989778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-061b8fd2-bf07-49c1-b668-09167e78d336 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083197 Aug 22 19:45:56.990400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1222/2292] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:56 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:57.193166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:57.193801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:57.199759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:57.200239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:57.200696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:57.201379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:57.201826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:57.202243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:57.329564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:57.338282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-331c4ad7-2816-4576-bf9c-9638ff6e3533 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149433 Aug 22 19:45:57.338851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1071/2293] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:57 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:57.653395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:57.653985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:57.660373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:57.660846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:57.661273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:57.662529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:57.662971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:57.663398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:57.725302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:57.733382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f8202ec7-387d-42c8-af92-6f8d5b9c2f98 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083965 Aug 22 19:45:57.733944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1223/2294] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:57 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:57.996811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:57.997430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:58.003794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:58.004286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:58.004730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:58.005940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:58.006537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:58.006977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:58.011344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:58.011982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:58.017726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:58.018399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:58.018831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:58.019512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:58.019980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:58.020403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:58.082427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:58.092851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6b028681-ca47-4d78-90f2-ce6858d51eca tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085429 Aug 22 19:45:58.093426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1224/2295] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:58 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:58.143969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:58.152753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ba78695a-23fc-4cd8-ab33-a889db4daa1e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.159750 Aug 22 19:45:58.153319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1072/2296] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:57 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:58.359833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:58.360401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:58.366375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:58.366856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:58.367288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:58.367998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:58.368445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:58.368868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:58.496851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:58.504986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3ccb81dc-33ee-4bac-b900-969a3772e24a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149174 Aug 22 19:45:58.505561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1225/2297] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:58 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:58.753941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:58.754546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:58.761045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:58.761518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:58.761946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:58.762628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:58.763073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:58.763489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:58.823963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:58.831965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fff3db6b-6be2-4cdc-bc3c-ec050e1d136b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081774 Aug 22 19:45:58.832529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1073/2298] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:58 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:59.113781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:59.114382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:59.120791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:59.121260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:59.121686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:59.122361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:59.122809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:59.123229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:59.173825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:59.174635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:59.181323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:59.181481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:59.181918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:59.182636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:59.183095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:59.183518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:59.183737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:59.192073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ed7b29bb-e57a-4c6e-8e02-7f724cf56c34 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082403 Aug 22 19:45:59.192647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1226/2299] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:59 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:59.309280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:59.318454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ebd80f1-d501-4e35-9e92-dd5aca7acd50 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148009 Aug 22 19:45:59.331667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1074/2300] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:59 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:45:59.526055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:59.526667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:59.532607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:59.533080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:59.533507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:59.534184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:59.534631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:59.535050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:59.660676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:59.668753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-076461f3-aaeb-4a6a-aa83-367f74057224 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146574 Aug 22 19:45:59.669318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1227/2301] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:59 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:45:59.852592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:45:59.853205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:45:59.859182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:59.859685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:59.860124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:59.860894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:45:59.861254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:45:59.861671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:45:59.922707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:45:59.931240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df1e33da-314c-4bb9-a380-6aacfc0f2038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082464 Aug 22 19:45:59.931818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1075/2302] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:45:59 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:00.213864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:00.214489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:00.220919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:00.221413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:00.221847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:00.222574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:00.223024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:00.223481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:00.284158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:00.292259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c7366308-08c5-4ce4-b8d8-382298e07c74 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082500 Aug 22 19:46:00.292828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1228/2303] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:00 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:00.340706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:00.341309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:00.343605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:00.348835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:00.349308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:00.349741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:00.350424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:00.350871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:00.351285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:00.483108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:00.491629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62580558-5aab-4dbd-a290-53fc30f997ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154725 Aug 22 19:46:00.492208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1076/2304] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:00 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:00.690302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:00.690837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:00.697818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:00.698306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:00.698747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:00.699440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:00.699930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:00.700489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:00.826564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:00.834637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eed12a98-6de6-4c42-8a03-131835326d37 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148268 Aug 22 19:46:00.835473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1229/2305] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:00 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:00.953460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:00.953996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:00.959920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:00.960668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:00.961100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:00.961796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:00.962250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:00.962676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:01.022607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:01.030626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-140e6bf5-f512-4793-af0e-83e88a0b0dd6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081072 Aug 22 19:46:01.031192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1077/2306] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:00 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:01.312780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:01.313315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:01.319841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:01.320325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:01.320763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:01.321449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:01.321901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:01.322324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:01.384019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:01.392200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0533d204-8b5f-4725-b0fe-25e2d0d67e93 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083388 Aug 22 19:46:01.392775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1230/2307] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:01 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:01.512772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:01.513415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:01.519869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:01.520360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:01.521302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:01.521994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:01.522452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:01.522879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:01.652359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:01.660498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a21465f6-fc22-4f8c-8b03-64c369ab9a9d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151525 Aug 22 19:46:01.661071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1078/2308] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:01 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:01.855619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:01.856200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:01.862253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:01.862738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:01.863168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:01.863892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:01.864340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:01.864760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:01.992002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:02.000031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9f7a26cf-0169-4d53-9af3-9a3c8e9cf35f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148311 Aug 22 19:46:02.000589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1231/2309] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:01 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:02.051163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:02.051800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:02.057669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:02.058153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:02.058589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:02.059277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:02.059752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:02.060178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:02.127885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:02.136080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-435d3127-f146-42ce-aef7-f4e73eb9a10c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088724 Aug 22 19:46:02.136646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1079/2310] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:02 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:02.413167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:02.413741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:02.420108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:02.420587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:02.421021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:02.421710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:02.422161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:02.422584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:02.484714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:02.492918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-10fa6f6c-cd88-43b7-bf4f-65f599a2c058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083645 Aug 22 19:46:02.493481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1232/2311] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:02 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:02.681370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:02.681988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:02.688524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:02.689009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:02.689446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:02.690134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:02.690588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:02.691010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:02.706121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:02.817263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:02.825962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-976d7b92-5403-4d3e-92b9-c3d034928e2c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148967 Aug 22 19:46:02.826546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1080/2312] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:02 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:03.021746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:03.022285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:03.028259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:03.028739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:03.029169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:03.029858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:03.030306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:03.030728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:03.157312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:03.157920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:03.159616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:03.164426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:03.164907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:03.165339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:03.166031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:03.166474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:03.166894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:03.168405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2ca50647-ab1f-4604-8e3f-72e6b94f30c4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150656 Aug 22 19:46:03.169006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1233/2313] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:03 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:03.227188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:03.235241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88788b48-cf8b-4f29-9cb4-9cc572e29bc2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081792 Aug 22 19:46:03.235831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1081/2314] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:03 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:03.514440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:03.515061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:03.522035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:03.522516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:03.522950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:03.523689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:03.524140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:03.524561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:03.584757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:03.593105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-36174b96-d586-4c98-bc28-ba2ca6aa5dfe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082922 Aug 22 19:46:03.593670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1234/2315] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:03 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:03.846213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:03.846856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:03.853260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:03.853736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:03.854170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:03.854852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:03.855303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:03.855753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:03.985039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:03.993242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10b7de90-b920-4668-acfa-5e5eb04cc901 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150839 Aug 22 19:46:03.993815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1082/2316] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:03 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:04.190062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:04.190673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:04.197322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:04.197792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:04.198220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:04.198897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:04.199340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:04.199786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:04.257563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:04.258186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:04.264084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:04.264575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:04.265016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:04.265716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:04.266170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:04.266595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:04.326980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:04.328078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:04.335567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-12a63602-f4d9-4e77-a81f-c31a3ee5eac1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149314 Aug 22 19:46:04.336271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1235/2317] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:04 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:04.336405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a1fcda0-177f-49ea-b295-a3da49fc34ac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083245 Aug 22 19:46:04.336919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1083/2318] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:04 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:04.615313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:04.615945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:04.622287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:04.622764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:04.623195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:04.623914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:04.624368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:04.624797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:04.639225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:04.685617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:04.693728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ac181e78-e2dc-41ed-8593-53369006dcdf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082905 Aug 22 19:46:04.694291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1236/2319] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:04 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:05.014644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:05.015256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:05.022166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:05.022642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:05.023073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:05.023785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:05.024233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:05.024652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:05.158320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:05.167121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1650b90-7d69-48a3-a601-23f660f688df tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156241 Aug 22 19:46:05.167706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1084/2320] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:05 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:05.356734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:05.356954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:05.357267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:05.357491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:05.363110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:05.363299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:05.363589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:05.363816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:05.364059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:05.364350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:05.364766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:05.365050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:05.365205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:05.365580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:05.365717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:05.365919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:05.430391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:05.438799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9accb03e-437c-4b75-9453-17b9a091bb79 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086134 Aug 22 19:46:05.439449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1237/2321] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:05 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:05.496509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:05.504601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74ef04b4-a2b9-4c25-9b99-b56ca69a6e74 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151824 Aug 22 19:46:05.505679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1085/2322] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:05 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:05.714695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:05.715316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:05.721877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:05.722358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:05.722795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:05.723484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:05.723964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:05.724387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:05.784499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:05.792671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d4fbdab2-75ec-45c1-863c-13040a4cdd77 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081862 Aug 22 19:46:05.793245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1238/2323] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:05 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:06.187068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:06.187705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:06.194647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:06.195125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:06.195563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:06.196275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:06.196726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:06.197148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:06.325848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:06.334930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c427111-3e9e-4ab2-ba76-790b2ff5f04f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151723 Aug 22 19:46:06.335777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1086/2324] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:06 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:06.460001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:06.460958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:06.466870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:06.467345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:06.467811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:06.468499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:06.468947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:06.469364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:06.525795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:06.526406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:06.529707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:06.532375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:06.532849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:06.533277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:06.533976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:06.534422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:06.534844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:06.538263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-982f64c0-40a4-4a9e-ac9b-3370aa56bea4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082162 Aug 22 19:46:06.538955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1239/2325] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:06 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:06.678195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:06.686206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ea29ec8-00c7-4893-a7af-c6a5e1ff42d8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.164291 Aug 22 19:46:06.686776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1087/2326] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:06 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:06.812893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:06.813433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:06.820412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:06.820886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:06.821314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:06.821990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:06.822441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:06.822857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:06.889570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:06.898038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-46a5eb75-86d2-427b-a5f3-a18deaabcacb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.089073 Aug 22 19:46:06.898611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1240/2327] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:06 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:07.356245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:07.356862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:07.363305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:07.363828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:07.364268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:07.364955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:07.365407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:07.365828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:07.493305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:07.501346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-649e4b85-d01c-4a42-addf-75c5fcec9ac8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148998 Aug 22 19:46:07.501904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1088/2328] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:07 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:07.558265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:07.558887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:07.565428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:07.565906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:07.566341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:07.567165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:07.568202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:07.568611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:07.631036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:07.639092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-35a05198-34ee-43cf-92af-613841ae9678 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084744 Aug 22 19:46:07.639668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1241/2329] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:07 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:07.707672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:07.708211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:07.715013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:07.715492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:07.715952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:07.716643 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:07.717096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:07.717504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:07.847095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:07.855188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2b65d90-f7f1-44a7-af87-c33d9577b9aa tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151533 Aug 22 19:46:07.855771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1089/2330] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:07 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:07.919763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:07.920377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:07.926776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:07.927801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:07.928241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:07.928927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:07.929378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:07.929802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:07.990541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:07.998664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1a2c2e45-3f41-40bc-8adc-6127f9f6e23a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082870 Aug 22 19:46:07.999228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1242/2331] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:07 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:08.521434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:08.522042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:08.528436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:08.528911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:08.529341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:08.530021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:08.530466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:08.530885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:08.659404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:08.660541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:08.661158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:08.667532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:08.668049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:08.668384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9c10017-83bc-4cab-8457-411aff1420d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150832 Aug 22 19:46:08.668507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:08.668952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1090/2332] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:08 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:08.669166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:08.669633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:08.670096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:08.730436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:08.738536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fec3c63d-c02d-4699-b976-849770e05f1a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082173 Aug 22 19:46:08.739098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1243/2333] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:08 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:08.875542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:08.876109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:08.882045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:08.882530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:08.882970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:08.883696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:08.884155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:08.884703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:09.012083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:09.019915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:09.020439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-63f9dbd7-3deb-4627-bc63-d83a416c9875 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148553 Aug 22 19:46:09.020589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:09.021332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1091/2334] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:08 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:09.027407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:09.027935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:09.028376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:09.029070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:09.029526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:09.029951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:09.092119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:09.100772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-05d9e8bb-9fc0-447b-becb-b96ad6d67fe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084737 Aug 22 19:46:09.101350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1244/2335] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:09 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:09.690340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:09.690957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:09.697341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:09.697822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:09.698249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:09.698959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:09.699406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:09.699858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:09.758896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:09.759543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:09.765518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:09.765992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:09.766421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:09.767104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:09.767548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:09.767997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:09.832370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:09.832538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:09.841544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-31ca6131-b117-41eb-8b6c-32d18d2b5360 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086482 Aug 22 19:46:09.841821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4cc17fed-faa3-4dbd-9024-4520a66d2587 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155260 Aug 22 19:46:09.842307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1245/2336] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:09 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:09.842912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1092/2337] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:09 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:10.041499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:10.042160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:10.048354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:10.048832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:10.049263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:10.049941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:10.050385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:10.050803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:10.121633 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:10.122254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:10.128515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:10.129000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:10.129437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:10.130660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:10.131115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:10.131959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:10.180806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:10.189090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9cf1f5e7-0baf-407f-b854-7871ece60932 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151448 Aug 22 19:46:10.189663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1246/2338] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:10 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:10.194792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:10.203295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa9cbbf0-0db0-4d90-aef0-0083c189726c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085781 Aug 22 19:46:10.203882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1093/2339] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:10 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:10.862364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:10.862599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:10.863068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:10.863183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:10.869501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:10.869827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:10.870010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:10.870307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:10.870428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:10.870741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:10.871130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:10.871442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:10.871565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:10.871904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:10.872136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:10.872321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:10.933094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:10.941335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2516ff37-e3a3-40d8-8a42-a320df8b379a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082847 Aug 22 19:46:10.941907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1247/2340] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:11.004235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:11.012295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e669a68-4c8c-4d02-900c-b8f991251ac3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153753 Aug 22 19:46:11.012861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1094/2341] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:10 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:11.211587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:11.212224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:11.218644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:11.219128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:11.219560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:11.220282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:11.220732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:11.221157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:11.225535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:11.226151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:11.231999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:11.232478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:11.232916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:11.233609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:11.234126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:11.234555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:11.295773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:11.304474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f5de574-e458-4211-972c-256ee1e905a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083286 Aug 22 19:46:11.305049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1095/2342] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:11 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:11.353081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:11.361242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-51b31beb-5049-4a24-bc69-c3d7e4cee186 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154340 Aug 22 19:46:11.361799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1248/2343] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:11 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:11.962371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:11.963153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:11.971190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:11.972303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:11.972303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:11.972883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:11.973377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:11.974515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:12.034328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:12.035494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:12.038483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:12.041836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:12.042322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:12.042758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:12.043451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:12.043925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:12.044354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:12.046492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75a5a12f-90af-4d6a-ba7b-5983c7263a61 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088674 Aug 22 19:46:12.047055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1096/2344] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:11 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:12.173828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:12.181996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d1e53e38-bce4-4744-981d-d060a592ec87 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151449 Aug 22 19:46:12.182566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1249/2345] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:12 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:12.325242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:12.325940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:12.331806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:12.332281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:12.332712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:12.334134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:12.334586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:12.335004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:12.337768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:12.382802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:12.383427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:12.389775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:12.390260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:12.390692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:12.391379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:12.391858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:12.392359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:12.397130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:12.405156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ce3c774-60ff-4b01-a762-21b9137cf0bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083750 Aug 22 19:46:12.405723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1097/2346] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:12 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:12.521050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:12.529063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fb4b3804-3bc9-4ee7-b9c4-b71b572f2963 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150666 Aug 22 19:46:12.529629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1250/2347] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:12 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:13.067531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:13.068717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:13.075059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:13.075541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:13.076001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:13.076683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:13.077130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:13.077550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:13.142087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:13.151160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e5767571-5b71-454d-b94f-f082a12bab2f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087538 Aug 22 19:46:13.151737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1098/2348] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:13 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:13.203763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:13.204376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:13.211066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:13.211545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:13.212017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:13.212705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:13.213155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:13.213577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:13.339441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:13.347527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-da541126-3cda-40e2-9d50-cc9bde350e36 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147626 Aug 22 19:46:13.348131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1251/2349] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:13.425713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:13.426318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:13.432240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:13.432717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:13.433154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:13.433836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:13.434284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:13.434703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:13.494704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:13.502875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9965375-ae0d-4676-a22b-57d78ddfcf9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.080998 Aug 22 19:46:13.503434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1099/2350] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:13.549117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:13.549730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:13.556183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:13.556663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:13.557102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:13.557786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:13.558234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:13.558656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:13.683497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:13.691578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a34567f1-6e59-4672-aadf-4d4b944552df tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146327 Aug 22 19:46:13.692179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1252/2351] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:13 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:14.174664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:14.175867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:14.184933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:14.185412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:14.185842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:14.186527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:14.186976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:14.187396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:14.248332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:14.257180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4fafedda-b8be-4613-af4f-db21c60dae59 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.089324 Aug 22 19:46:14.257747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1100/2352] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:14.369281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:14.369932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:14.376037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:14.376516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:14.376952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:14.377636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:14.378087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:14.378509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:14.382410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:14.506479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:14.514461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-09277927-7aaa-437b-8b76-839294ff0479 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149659 Aug 22 19:46:14.515029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1253/2353] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:14.522930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:14.523559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:14.529623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:14.530107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:14.530549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:14.531241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:14.531722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:14.532150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:14.592622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:14.601205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44d65312-156c-4fba-a12d-068316bd19c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082190 Aug 22 19:46:14.601771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1101/2354] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:14.713459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:14.714002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:14.720344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:14.720817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:14.721247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:14.721931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:14.722380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:14.722802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:14.847264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:14.855948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-aa1d1b0c-2381-4b50-b0da-f057f9e15ee7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146577 Aug 22 19:46:14.856515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1254/2355] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:14 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:15.278203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:15.278843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:15.285377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:15.285858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:15.286295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:15.286982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:15.287433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:15.287956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:15.351343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:15.359751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e53bfac-444a-4e59-8b3f-078148c8e3e5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085357 Aug 22 19:46:15.360454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1102/2356] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:15.535139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:15.535785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:15.541809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:15.542289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:15.542724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:15.543407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:15.543886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:15.544311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:15.621664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:15.622282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:15.628326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:15.628841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:15.629287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:15.629982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:15.631096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:15.631527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:15.674293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:15.683067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-28a64681-1da6-4c90-9561-118c1475f712 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151721 Aug 22 19:46:15.683844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1255/2357] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:15 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:15.695070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:15.703287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-63aaf3e9-3189-4a39-be7c-6c8b66607587 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085418 Aug 22 19:46:15.703955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1103/2358] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:15.876542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:15.877155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:15.883635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:15.884148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:15.884584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:15.885271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:15.885720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:15.886143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:16.012050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:16.020536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1e071973-67cd-4bac-bbfe-84adaf42145d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147784 Aug 22 19:46:16.021098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1256/2359] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:15 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:16.380989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:16.381640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:16.388327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:16.388801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:16.389230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:16.389907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:16.390351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:16.390767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:16.450883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:16.459568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8936da6f-06c9-4331-9f4a-ebbe5175cc5e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082682 Aug 22 19:46:16.460408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1104/2360] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:16 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:16.704965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:16.705581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:16.712712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:16.713196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:16.713631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:16.714323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:16.714808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:16.715229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:16.724201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:16.724814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:16.730742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:16.731215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:16.731671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:16.732352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:16.732799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:16.733230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:16.794649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:16.802953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a0f5821-bc12-4a6f-ac7d-41d5d892baf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082478 Aug 22 19:46:16.803536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1105/2361] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:16.846994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:16.855162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5ad743d1-26b8-4fbf-8425-10561492f7d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154199 Aug 22 19:46:16.855745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1257/2362] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:16 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:17.041426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:17.041966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:17.047956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:17.048444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:17.048884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:17.049575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:17.050032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:17.050460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:17.181921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:17.190075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c4d3b6a-ae25-40c7-96ab-8dcb03ddf925 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152575 Aug 22 19:46:17.190637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1106/2363] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:17 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:17.480446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:17.481055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:17.487387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:17.487900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:17.488328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:17.489000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:17.489579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:17.490496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:17.550344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:17.559020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-873c5a85-e732-4709-9d74-a5ef615b87f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082507 Aug 22 19:46:17.559585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1258/2364] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:17 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:17.823797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:17.824419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:17.830888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:17.831373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:17.831848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:17.832545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:17.833006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:17.833436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:17.876621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:17.877390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:17.884723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:17.885312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:17.885840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:17.886549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:17.887002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:17.887426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:17.896065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:17.904206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2694eb7a-6599-4f6c-a6a0-ea5d966d51b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084283 Aug 22 19:46:17.904779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1107/2365] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:18.017185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:18.026944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-532105f0-0d98-486f-a928-adf13948bec5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154398 Aug 22 19:46:18.027510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1259/2366] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:18.211889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:18.212509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:18.218587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:18.219071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:18.219509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:18.220233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:18.220686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:18.221124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:18.348022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:18.356586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0d09df01-9ddf-48c2-ac1c-98d8eb864207 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148927 Aug 22 19:46:18.357152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1108/2367] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:18 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:18.580250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:18.580949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:18.588166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:18.588642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:18.589145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:18.589925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:18.590407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:18.590825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:18.651359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:18.659673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d89f3e7a-e340-4b70-b23c-297161fe76b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083763 Aug 22 19:46:18.660340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1260/2368] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:18 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:18.924288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:18.924867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:18.932009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:18.932483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:18.932915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:18.933601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:18.934049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:18.934468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:18.998350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:19.006384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9aad9599-f9cb-4d3a-bb2b-358b81f4cdd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085992 Aug 22 19:46:19.006942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1109/2369] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:19.047575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:19.048315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:19.054862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:19.055329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:19.055792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:19.056471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:19.056911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:19.057329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:19.184124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:19.192379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2a3a4d24-ae06-4a37-aa5f-6e075da7e62f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148576 Aug 22 19:46:19.193002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1261/2370] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:19 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:19.378200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:19.378816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:19.384786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:19.385265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:19.385700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:19.386382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:19.386837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:19.387249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:19.513759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:19.522251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e388a31e-ab4d-4346-8570-3f4dfaf7172e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147922 Aug 22 19:46:19.522809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1110/2371] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:19 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:19.680876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:19.681494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:19.687905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:19.688366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:19.688809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:19.689501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:19.689964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:19.690380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:19.751155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:19.759786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6f99517e-6bc3-482c-9f41-b8b98b15c2c3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082676 Aug 22 19:46:19.760321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1262/2372] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:20.026389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:20.026932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:20.033306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:20.033779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:20.034211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:20.034887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:20.035334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:20.035783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:20.098276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:20.106448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12a796f4-12a5-42d1-9532-3ec387bd22c8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084023 Aug 22 19:46:20.107003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1111/2373] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:20 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:20.213259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:20.213872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:20.215972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:20.224699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:20.225585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:20.226384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:20.227674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:20.228554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:20.229375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:20.358643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:20.366719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7e5ab5fa-9819-4dd4-802e-75accf91d6d0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.157530 Aug 22 19:46:20.367279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1263/2374] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:20 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:20.542311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:20.542915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:20.548899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:20.549374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:20.549805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:20.550484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:20.550931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:20.551350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:20.679602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:20.687832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f13d982f-92c6-46a7-98a3-8bd68aa22714 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149290 Aug 22 19:46:20.688455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1112/2375] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:20 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:20.780698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:20.781288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:20.787618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:20.788124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:20.788555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:20.789234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:20.789681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:20.790103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:20.854213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:20.862370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fd34a7b5-05f3-48b9-af21-ef581b649bd1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085435 Aug 22 19:46:20.862939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1264/2376] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:20 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:21.127574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:21.128229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:21.135268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:21.135785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:21.136222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:21.136906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:21.137356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:21.137777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:21.200044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:21.202206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:21.210048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-259cd99b-38a5-42e7-88b5-97d2e6265fa9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.086343 Aug 22 19:46:21.210868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1113/2377] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:21.387257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:21.387835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:21.393756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:21.394229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:21.394657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:21.395343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:21.396447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:21.396877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:21.520030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:21.528076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0409e7e7-6ad2-4911-a40f-a8c5a4c820bf tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.144665 Aug 22 19:46:21.528654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1265/2378] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:21 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:21.709655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:21.710566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:21.716521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:21.717006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:21.717446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:21.718139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:21.718594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:21.719023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:21.845302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:21.853881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9ec87f5-af21-41b9-8a34-89106652a7b6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148528 Aug 22 19:46:21.854444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1114/2379] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:21 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:21.882217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:21.882831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:21.889175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:21.889652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:21.890085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:21.890769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:21.891218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:21.891687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:21.951366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:21.959783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-975d4faf-5132-484e-b8cc-5afffae256a1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081359 Aug 22 19:46:21.960555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1266/2380] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:21 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:22.231244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:22.231887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:22.238410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:22.238899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:22.239338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:22.240857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:22.241448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:22.241897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:22.306191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:22.314259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60f75269-b92a-4f41-b340-43f54918f1d1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.087000 Aug 22 19:46:22.314843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1115/2381] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:22 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:22.549691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:22.550242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:22.556865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:22.557335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:22.557764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:22.558439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:22.558882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:22.559298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:22.684847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:22.692898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6659b565-7b5e-4130-a805-81be79c31f1d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147116 Aug 22 19:46:22.693477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1267/2382] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:22 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:22.875042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:22.875585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:22.881604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:22.882086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:22.882522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:22.883210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:22.883682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:22.884112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:22.981504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:22.982153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:22.988554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:22.989037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:22.989470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:22.990194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:22.990643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:22.991067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:23.011479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:23.019589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21bff5f0-5fef-4e7a-b731-f08aa35dca2d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148411 Aug 22 19:46:23.020230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1116/2383] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:22 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:23.051571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:23.059787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0b830b47-b00d-4446-97b0-3ca2eb478e30 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082117 Aug 22 19:46:23.060351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1268/2384] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:22 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:23.334394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:23.335064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:23.341678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:23.342156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:23.342585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:23.343267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:23.343769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:23.344190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:23.405995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:23.414754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b3ac8aad-cbf2-43f3-81f6-dd7473f26a86 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084249 Aug 22 19:46:23.415321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1117/2385] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:23.714721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:23.715330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:23.721509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:23.721987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:23.722424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:23.723111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:23.723562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:23.724018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:23.851704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:23.853924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:23.861441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bc8b36d0-096a-4d48-9fa3-acab003cac7a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151383 Aug 22 19:46:23.862012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1269/2386] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:23 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:24.041833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:24.042360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:24.048674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:24.049149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:24.049582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:24.050264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:24.050708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:24.051129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:24.080391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:24.081008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:24.088164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:24.088651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:24.089088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:24.089784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:24.090238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:24.090661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:24.153598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:24.161621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-20b06946-c191-4179-aadc-eb25640f2ef6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085296 Aug 22 19:46:24.162199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1270/2387] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:24.184907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:24.193111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-61bbd366-e3b5-4201-a580-0a9d84526d15 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.155317 Aug 22 19:46:24.193668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1118/2388] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:24 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:24.435557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:24.436205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:24.442258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:24.442742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:24.443182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:24.443961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:24.444438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:24.444864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:24.507797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:24.515954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b4799fc4-4fb3-43fa-9c7b-72d992e4cb21 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084177 Aug 22 19:46:24.516528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1271/2389] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:24.882917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:24.883486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:24.889891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:24.890368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:24.890797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:24.891475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:24.891985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:24.892403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:25.018234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:25.028035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-167237ab-1fe9-445c-9d33-bdd58637eff7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149551 Aug 22 19:46:25.028592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1119/2390] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:24 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:25.182691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:25.183307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:25.189735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:25.190208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:25.190635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:25.191318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:25.191784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:25.192202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:25.214982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:25.215760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:25.221613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:25.222105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:25.222542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:25.223242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:25.223721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:25.224151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:25.252824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:25.261462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-015fa968-911a-4bec-93cc-97503280b0f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082643 Aug 22 19:46:25.262048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1272/2391] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:25 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:25.356960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:25.366867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9027f113-a868-42c0-a1fb-44ea89ac1ae2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.155052 Aug 22 19:46:25.367470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1120/2392] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:25 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:25.537404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:25.538511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:25.544491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:25.544970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:25.545404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:25.546083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:25.546533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:25.546956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:25.609449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:25.618227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dde0e6cf-67ac-4843-b79e-1e5c2686f1f8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084663 Aug 22 19:46:25.618787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1273/2393] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:25 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:26.049511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:26.050147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:26.057009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:26.057489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:26.057921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:26.058608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:26.059115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:26.059482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:26.188768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:26.197475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2448974-4ac9-4822-b9d1-128fe525a7f5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151791 Aug 22 19:46:26.198041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1121/2394] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:26 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:26.282557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:26.283152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:26.289916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:26.290463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:26.290930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:26.292112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:26.292237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:26.292667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:26.357244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:26.366365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5487bd40-bd4f-4f17-acef-6fa54e9e3c5c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087587 Aug 22 19:46:26.366954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1274/2395] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:26 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:26.388463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:26.389078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:26.395137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:26.395616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:26.396081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:26.396769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:26.397217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:26.397640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:26.525459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:26.533541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3eab1d44-5b31-4217-8131-54f7d192fd02 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149005 Aug 22 19:46:26.534111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1122/2396] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:26 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:26.638974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:26.639617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:26.645613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:26.646094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:26.646531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:26.647216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:26.647681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:26.648636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:26.707025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:26.715983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9a72806d-1e0d-45d3-a04f-cbbb2b798daa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.080782 Aug 22 19:46:26.716573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1275/2397] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:26 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:27.219004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:27.219942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:27.226189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:27.226842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:27.227301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:27.228019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:27.228484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:27.228907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:27.363724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:27.372339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-510e2403-b98a-4062-b249-03778c8f2711 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.157246 Aug 22 19:46:27.372889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1123/2398] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:27 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:27.388906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:27.389770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:27.396503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:27.396929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:27.397363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:27.398070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:27.399027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:27.399449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:27.470324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:27.478982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1eaa3e67-b8a9-4e48-bb08-1775b0ac50af tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.094468 Aug 22 19:46:27.479541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1276/2399] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:27.554169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:27.554785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:27.560675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:27.561158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:27.561682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:27.562358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:27.562751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:27.563172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:27.690840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:27.699497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18bac477-eb4e-4239-b1b0-637cfcd2db40 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149150 Aug 22 19:46:27.700097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1124/2400] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:27 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:27.737297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:27.737907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:27.744338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:27.744808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:27.745236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:27.745905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:27.746349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:27.746764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:27.809191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:27.817228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8f8505ab-20c7-444b-a1f8-7234bb3948bb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083844 Aug 22 19:46:27.817786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1277/2401] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:28.394250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:28.394862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:28.401004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:28.401421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:28.401856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:28.402544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:28.402997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:28.403419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:28.499193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:28.499834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:28.506363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:28.506846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:28.507280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:28.508546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:28.508998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:28.509422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:28.538288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:28.546980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6757cabc-fdd8-4c51-8cbd-b5935ee1910a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156744 Aug 22 19:46:28.547555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1125/2402] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:28 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:28.571031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:28.579175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4a923ce6-7283-4729-b245-9caa3488d5e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083727 Aug 22 19:46:28.579743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1278/2403] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:28 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:28.720454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:28.721081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:28.722918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:28.728614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:28.729092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:28.729524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:28.730209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:28.730658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:28.731076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:28.838324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:28.839063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:28.846862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:28.847366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:28.847853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:28.848544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:28.848990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:28.849413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:28.858393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:28.866608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ebaa9a54-712e-47e9-941b-a57ef209ac6c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149967 Aug 22 19:46:28.879409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1126/2404] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:28 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:28.910106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:28.918648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-439262ba-591e-4b10-9f91-75b5a180e8eb tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084465 Aug 22 19:46:28.919209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1279/2405] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:29.568903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:29.569560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:29.576008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:29.576480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:29.576915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:29.577602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:29.578056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:29.578477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:29.598862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:29.599471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:29.606708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:29.607352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:29.608174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:29.608865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:29.609313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:29.609727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:29.673043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:29.681435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c81c4524-c393-4cc5-a473-74c0ae1b0617 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086278 Aug 22 19:46:29.682027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1280/2406] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:29 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:29.707543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:29.716489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa97b5ca-7c2c-48da-9adc-3b30473664f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151569 Aug 22 19:46:29.717051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1127/2407] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:29 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:29.888121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:29.888740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:29.894713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:29.895185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:29.895612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:29.896314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:29.896758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:29.897179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:29.939213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:29.939885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:29.945738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:29.946228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:29.946669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:29.947394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:29.947880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:29.948307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:30.015830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:30.024682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fee18c2a-07a3-4f6b-91fa-11760f92cb2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.089304 Aug 22 19:46:30.025254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1128/2408] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:30.029312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:30.037527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1028e25c-003a-4cd7-a198-b808e37815e0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153237 Aug 22 19:46:30.038083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1281/2409] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:29 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:30.702340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:30.702987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:30.709449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:30.709922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:30.710650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:30.711330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:30.711834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:30.712254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:30.737888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:30.738488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:30.745466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:30.745947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:30.746381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:30.747070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:30.747522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:30.747977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:30.774109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:30.782212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24985307-0404-4b85-981f-4cbad3656ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083925 Aug 22 19:46:30.782974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1129/2410] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:30.875504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:30.883562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-949041f7-0793-40c6-b692-cde302763273 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149451 Aug 22 19:46:30.884152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1282/2411] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:30 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:31.045830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:31.046369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:31.052205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:31.052760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:31.053201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:31.053880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:31.054962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:31.055386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:31.058465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:31.059087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:31.065020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:31.065500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:31.065936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:31.066627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:31.067078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:31.067504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:31.070019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:31.119445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:31.127980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1dacb81-2fed-4f54-aaf3-63a6c715662d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085998 Aug 22 19:46:31.128545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1130/2412] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:31.197505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:31.205748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4bbae342-8069-4cf5-9a6c-61231a02cc6d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151740 Aug 22 19:46:31.206312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1283/2413] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:31 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:31.802453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:31.804357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:31.809493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:31.809972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:31.810406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:31.811085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:31.811532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:31.811975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:31.873831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:31.881884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0169849-df5d-4fe8-bcc1-262fd011bba3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083429 Aug 22 19:46:31.882481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1131/2414] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:31.904029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:31.904643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:31.910758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:31.911242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:31.911701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:31.912389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:31.912838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:31.913258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:32.037552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:32.045553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bcc68bb8-515d-43bb-8cec-96af1c96a1ca tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.145303 Aug 22 19:46:32.046124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1284/2415] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:31 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:32.148129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:32.148746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:32.154828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:32.155341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:32.155888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:32.156581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:32.157027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:32.157448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:32.218376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:32.226318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:32.228391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:32.233078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e616f854-59f6-47f5-bb0b-e285d89c1fd5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.088604 Aug 22 19:46:32.233825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1132/2416] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:32.235666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:32.236154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:32.236584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:32.237274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:32.237717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:32.238136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:32.369093 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:32.377235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9781f396-ed9c-422a-a07c-1801462f3b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154743 Aug 22 19:46:32.377798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1285/2417] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:32 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:32.903454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:32.904122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:32.910485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:32.910968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:32.911412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:32.912252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:32.912711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:32.913138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:32.979732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:32.987886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c68c5cf3-1964-4123-86dd-bcff4e590d83 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088222 Aug 22 19:46:32.988435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1133/2418] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:32 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:33.067321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:33.067960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:33.074829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:33.075308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:33.075775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:33.076461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:33.076909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:33.077331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:33.092781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:33.205414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:33.214432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bbdccdcf-fe7c-4409-a07c-8b6dd6ef0aeb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150948 Aug 22 19:46:33.215030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1286/2419] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:33 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:33.254155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:33.254772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:33.261174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:33.261655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:33.262120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:33.262804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:33.263255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:33.263698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:33.324753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:33.333051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b05edfa0-5a9a-49b3-a627-67934706ed6b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082636 Aug 22 19:46:33.333622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1134/2420] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:33 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:33.398355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:33.399025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:33.404888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:33.405362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:33.405794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:33.406522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:33.406914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:33.407331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:33.534087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:33.542212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6154ce08-c348-4658-9c55-0250f92c9d86 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147946 Aug 22 19:46:33.542755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1287/2421] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:33 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:34.009148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:34.009765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:34.016185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:34.016681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:34.017123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:34.017821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:34.018277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:34.018705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:34.079780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:34.088646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-613b18c3-41e3-49b8-8bad-c8a35e2d55ee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083913 Aug 22 19:46:34.089208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1135/2422] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:34.235762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:34.236374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:34.243117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:34.243598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:34.244063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:34.244753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:34.245201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:34.245623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:34.355589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:34.356151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:34.362124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:34.362612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:34.363049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:34.363772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:34.364223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:34.364646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:34.375786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:34.383824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-473145e1-f0d5-43a6-b7ec-7855d9a8c343 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152029 Aug 22 19:46:34.384492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1288/2423] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:34 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:34.426013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:34.434330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e75c47d5-2e9e-451e-8414-1f0adc7ba1c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083308 Aug 22 19:46:34.434891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1136/2424] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:34.563632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:34.564279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:34.570197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:34.571182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:34.571679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:34.572381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:34.572833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:34.573254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:34.698373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:34.706486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f8368760-31c2-4ca1-bf17-acfdcaba903b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146669 Aug 22 19:46:34.707052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1289/2425] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:34 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:35.109114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:35.109735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:35.117055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:35.117567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:35.118007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:35.118742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:35.119198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:35.119618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:35.185126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:35.193364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35abe87c-b381-4f4b-a81b-9177f1c33c6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088122 Aug 22 19:46:35.193930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1137/2426] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:35 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:35.404908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:35.405534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:35.411813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:35.412289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:35.412738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:35.413403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:35.413849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:35.414785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:35.454236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:35.455000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:35.461439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:35.461951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:35.462386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:35.463086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:35.463569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:35.464016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:35.524861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:35.533035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-afa4bf4d-bd8b-426f-88d0-8adf682aa991 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082613 Aug 22 19:46:35.533602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1138/2427] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:35.540899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:35.549030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d5053aa6-fb53-4379-91b4-2299ecbea795 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148101 Aug 22 19:46:35.549583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1290/2428] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:35 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:35.728095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:35.728692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:35.734633 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:35.735116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:35.735548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:35.736283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:35.736737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:35.737161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:35.864206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:35.872885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e784aafa-7ecd-4451-bd57-417c629440d7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148654 Aug 22 19:46:35.873447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1139/2429] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:35 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:36.214048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:36.214686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:36.220669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:36.221147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:36.221580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:36.222262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:36.222711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:36.223141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:36.287293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:36.295994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-93c91f0b-72b0-4a8d-b9cf-715ceb56f4b1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086621 Aug 22 19:46:36.296566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1291/2430] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:36.554578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:36.555783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:36.562272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:36.562749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:36.563182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:36.563891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:36.564337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:36.564756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:36.570078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:36.571286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:36.577734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:36.578221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:36.578651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:36.579333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:36.579812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:36.580236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:36.631247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:36.639522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5313258-e546-4671-b814-8d7dabca38fa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.088811 Aug 22 19:46:36.640130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1140/2431] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:36.707467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:36.716289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f26730df-3c19-4ee4-b457-fd5783672770 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150020 Aug 22 19:46:36.717124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1292/2432] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:36 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:36.894576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:36.895102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:36.901696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:36.902188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:36.902622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:36.903315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:36.903790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:36.904216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:37.031988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:37.040094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bde36d1f-f295-4215-91a2-a625412ccb68 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149447 Aug 22 19:46:37.040654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1141/2433] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:36 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:37.316451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:37.317063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:37.323983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:37.324495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:37.324927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:37.325644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:37.326090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:37.326532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:37.388264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:37.396535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1aabbffc-0051-4c8a-a21e-5eab0ec08032 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083937 Aug 22 19:46:37.397037 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1293/2434] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:37.661054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:37.661631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:37.668640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:37.669120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:37.669554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:37.670243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:37.670695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:37.671116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:37.732246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:37.737961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:37.738576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:37.740515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b982366-586e-4d7e-85c2-e1be910b3288 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083432 Aug 22 19:46:37.741082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1142/2435] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:37 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:37.746547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:37.747029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:37.747465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:37.748186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:37.748635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:37.749055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:37.882066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:37.891245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-78925c66-f209-4e70-9f60-81d572807e16 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.157082 Aug 22 19:46:37.891843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1294/2436] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:37 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:38.060780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:38.061396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:38.067280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:38.067797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:38.068234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:38.068922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:38.069371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:38.069793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:38.199334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:38.207423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f689b12a-1587-40ff-bef1-7f9362ec8e11 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150494 Aug 22 19:46:38.208018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1143/2437] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:38 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:38.417006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:38.417609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:38.423670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:38.424151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:38.424580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:38.425256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:38.425706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:38.426123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:38.486582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:38.494663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-78ea8db8-89c1-41fa-9180-7f09cab7dfb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081607 Aug 22 19:46:38.495222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1295/2438] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:38.762627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:38.763267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:38.769753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:38.770235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:38.770672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:38.771365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:38.771861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:38.772290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:38.832997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:38.841382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac8c718c-6ca5-4c4d-aa8e-08c74b3f73fc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083192 Aug 22 19:46:38.841943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1144/2439] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:38.912326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:38.912948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:38.919344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:38.919862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:38.920303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:38.920992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:38.921443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:38.921869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:39.046185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:39.054171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3cf013c7-c36d-45d8-9f8e-b25702e554af tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.145673 Aug 22 19:46:39.054790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1296/2440] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:38 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:39.229790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:39.230413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:39.236360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:39.236845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:39.237283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:39.237977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:39.238431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:39.238861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:39.365386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:39.373953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22fea018-c364-4cd4-9f40-72e5ca162eac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148490 Aug 22 19:46:39.374517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1145/2441] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:39 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:39.515062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:39.515691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:39.521580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:39.522086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:39.522517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:39.523195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:39.523662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:39.524082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:39.586447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:39.594433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-139c2c6e-6558-45a4-98e9-e67469c631a8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083213 Aug 22 19:46:39.594990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1297/2442] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:39 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:39.861640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:39.862190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:39.869443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:39.869934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:39.870373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:39.871069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:39.871521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:39.871975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:39.937385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:39.945497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2fceb5e9-37bd-4eb7-9e2f-14a25abcf5e0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.087801 Aug 22 19:46:39.946091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1146/2443] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:40.075500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:40.076134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:40.082482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:40.082956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:40.083382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:40.084088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:40.084533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:40.084950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:40.211861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:40.220049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-58278430-40f8-4fa5-a6d8-42697b59b333 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148333 Aug 22 19:46:40.220619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1298/2444] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:40 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:40.394589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:40.395107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:40.401524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:40.402004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:40.402431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:40.403109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:40.403549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:40.404000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:40.406467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:40.532125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:40.540265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2cec0786-b860-4024-9b93-411750d08484 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149597 Aug 22 19:46:40.540838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1147/2445] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:40 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:40.614627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:40.615232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:40.621250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:40.621722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:40.622153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:40.622833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:40.623277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:40.623717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:40.685930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:40.693890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dfd0e45a-3274-4f69-968b-038756f23dda tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083036 Aug 22 19:46:40.694450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1299/2446] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:40.966204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:40.966760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:40.973290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:40.973770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:40.974208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:40.974899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:40.975343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:40.975796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:41.038672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:41.047364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad8600e4-9c98-43be-b716-4380ef85417c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085093 Aug 22 19:46:41.047968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1148/2447] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:41.241445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:41.241978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:41.248421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:41.248891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:41.249319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:41.249998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:41.250443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:41.250861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:41.377253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:41.385864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8afc497d-b573-40f2-93e1-ab036a86b612 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148332 Aug 22 19:46:41.386434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1300/2448] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:41 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:41.561213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:41.561744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:41.567971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:41.568483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:41.568937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:41.569618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:41.570068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:41.571024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:41.701180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:41.709386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43c8aee4-716c-49fe-a576-53b109ed4351 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152078 Aug 22 19:46:41.710090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1149/2449] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:41 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:41.714499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:41.715483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:41.721045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:41.721558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:41.721988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:41.722668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:41.723118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:41.723541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:41.783059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:41.791178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0a0b929e-bd5f-4f80-9c6c-b6ef6cfdbe6e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.080792 Aug 22 19:46:41.791762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1301/2450] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:42.067941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:42.068587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:42.075036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:42.075487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:42.076019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:42.076707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:42.077158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:42.077580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:42.138524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:42.146829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b544cc58-0af5-47c5-99b4-6329c43c72c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082644 Aug 22 19:46:42.147397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1150/2451] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:42.406755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:42.407397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:42.414233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:42.415863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:42.416374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:42.417156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:42.417610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:42.418036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:42.549335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:42.558072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4f692eb4-2df3-4348-9ea0-c2e5dfb3b88b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155186 Aug 22 19:46:42.558638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1302/2452] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:42.730820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:42.731434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:42.737520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:42.738007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:42.738446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:42.739144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:42.739600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:42.740052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:42.811943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:42.812555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:42.818466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:42.818951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:42.819387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:42.820119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:42.820568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:42.820991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:42.825863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:42.885255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:42.893354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-95ee5ae5-de6b-4cb6-b313-4bee4ad56dac tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085275 Aug 22 19:46:42.893921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1303/2453] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:42.958005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:42.966384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8cd5f8a8-a43a-494b-a11f-fe6cb427c424 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.239904 Aug 22 19:46:42.966948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1151/2454] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:42 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:43.167885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:43.168493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:43.175455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:43.175961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:43.176436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:43.177158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:43.177636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:43.178110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:43.238015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:43.246481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f62b4126-280f-4212-9dc3-a65abc3b77aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082495 Aug 22 19:46:43.247035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1304/2455] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:43 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:43.580328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:43.580921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:43.587531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:43.588048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:43.588489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:43.589183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:43.589638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:43.590069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:43.717383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:43.725629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-629f1c7b-bf5f-4eaa-803f-1dcd75bf5463 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149293 Aug 22 19:46:43.726191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1152/2456] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:43 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:43.913901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:43.914491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:43.920927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:43.921405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:43.921833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:43.922510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:43.922961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:43.923396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:43.984453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:43.987888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:43.988505 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:43.993310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-57d82f6b-30cd-4716-86f8-80706c9686cd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083294 Aug 22 19:46:43.994049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1305/2457] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:43.994921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:43.995407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:43.995867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:43.996573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:43.997024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:43.997443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:44.127924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:44.136615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22ae29cd-762a-4f2a-8df4-bb6e812828a1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152637 Aug 22 19:46:44.137181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1153/2458] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:43 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:44.268334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:44.268949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:44.276274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:44.276761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:44.277203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:44.277899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:44.278351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:44.278774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:44.338436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:44.346524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0d9dbd71-7bbd-4b06-a90b-c404b31dd41b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082325 Aug 22 19:46:44.347083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1306/2459] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:44 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:44.746595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:44.747209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:44.753704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:44.754181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:44.754612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:44.755295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:44.755781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:44.756200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:44.884164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:44.892209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9bf931d8-faf1-48bb-b4e0-cbc352293613 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149444 Aug 22 19:46:44.892769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1154/2460] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:44 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:45.014819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:45.015354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:45.021677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:45.022155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:45.022584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:45.023262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:45.024306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:45.024725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:45.086999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:45.095013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e9a721dd-3275-454f-b89a-416fed26e883 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084093 Aug 22 19:46:45.095570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1307/2461] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:45 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:45.158043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:45.158661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:45.165313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:45.165798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:45.166233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:45.166935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:45.167390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:45.167849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:45.295082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:45.303223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-024e3a40-5d71-430c-abeb-4b52e48f18ac tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149090 Aug 22 19:46:45.303820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1155/2462] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:45 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:45.366514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:45.367201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:45.374076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:45.374641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:45.375145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:45.375979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:45.376544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:45.377147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:45.439604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:45.448253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-313e2cbe-b5cb-4017-9db0-c75a5e30a4b4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085877 Aug 22 19:46:45.448837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1308/2463] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:45 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:45.913734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:45.914851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:45.921316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:45.921796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:45.922237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:45.922932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:45.923383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:45.923838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:46.052144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:46.060865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1ddf0e3-ac6d-4a40-8456-bc811099ce69 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150969 Aug 22 19:46:46.061473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1156/2464] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:45 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:46.115923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:46.116530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:46.123481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:46.123999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:46.124436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:46.125127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:46.125578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:46.126000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:46.186670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:46.195421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0da4e39d-c4b7-4928-ba27-1fd9a9c31780 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083374 Aug 22 19:46:46.196012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1309/2465] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:46.324442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:46.325056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:46.334184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:46.334664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:46.335092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:46.336564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:46.337072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:46.337561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:46.462983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:46.469800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:46.470412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:46.471526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7374816c-cdbf-40bf-8a58-c75cb7d9ba30 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150898 Aug 22 19:46:46.472310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1157/2466] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:46 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:46.476416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:46.477503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:46.477936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:46.478621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:46.479071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:46.479493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:46.538472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:46.546523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3a9e81ad-f0a4-41e4-8019-b02e0d65bb79 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.080480 Aug 22 19:46:46.547089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1310/2467] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:46 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:47.082412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:47.083026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:47.090579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:47.091061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:47.091504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:47.092208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:47.092706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:47.093130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:47.217963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:47.218599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:47.225044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:47.225526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:47.225961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:47.227236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:47.227920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:47.228348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:47.234161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:47.242350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-679691e8-cefe-4546-92cf-9bf33c8ac06e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.163831 Aug 22 19:46:47.242923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1158/2468] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:47 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:47.272503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:46:47.272763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 (ip 10.222.0.61) !!! Aug 22 19:46:47.293128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:47.301211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8d556c47-7e2d-4bf1-bbba-61fbc2936a8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087111 Aug 22 19:46:47.301765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1311/2469] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:47.493387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:47.493919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:47.499874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:47.500358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:47.500800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:47.501490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:47.501942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:47.502364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:47.566324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:47.567023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:47.572975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:47.573470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:47.573901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:47.574582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:47.575025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:47.575446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:47.631044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:47.639773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50f683cf-5073-4ff8-9fe0-119879e6e842 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150920 Aug 22 19:46:47.640368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1159/2470] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:47 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:47.849893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:47.858670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-273f98de-de56-4659-b9ac-3948681660f2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.296219 Aug 22 19:46:47.859239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1312/2471] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:47 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:48.262911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:48.263525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:48.269937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:48.270414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:48.270844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:48.271526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:48.272001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:48.272420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:48.320871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:48.321658 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:48.323958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:48.329150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:48.330438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:48.330880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:48.331579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:48.332061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:48.332490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:48.393705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:48.401906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:48.402561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cc0612e5-29c8-42da-9f0f-ada075ccc539 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085514 Aug 22 19:46:48.403143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1313/2472] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:48.410415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d58b2665-f927-42bc-9c25-cdd8678474b9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151332 Aug 22 19:46:48.411084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1160/2473] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:48 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:48.661359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:48.661887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:48.668388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:48.668864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:48.669306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:48.669977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:48.670418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:48.670836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:48.794932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:48.804208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c5ce2b64-17c0-47a0-b4ab-d52df947c8e7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146186 Aug 22 19:46:48.805518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1314/2474] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:48 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:48.879270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:48.879943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:48.886417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:48.886893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:48.887336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:48.888054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:48.888506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:48.888927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:48.952655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:48.961859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5fb70e3a-b3f2-4b01-a458-7c55e9e3185d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085807 Aug 22 19:46:48.962430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1161/2475] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:48 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:49.423985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:49.424594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:49.432137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:49.432617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:49.432994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:49.433426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:49.433637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:49.433755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:49.434149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:49.434568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:49.440095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:49.440579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:49.441017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:49.441703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:49.442154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:49.442574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:49.499796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:49.507893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-32037837-71a3-4d98-844f-8f8e0a54aa72 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088033 Aug 22 19:46:49.508458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1315/2476] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:49.571203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:49.579332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f3631ea-3b7c-4655-9ae6-5294dd044ee0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150623 Aug 22 19:46:49.579931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1162/2477] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:49 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:49.826029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:49.826476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:49.832454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:49.832934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:49.833367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:49.834053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:49.834501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:49.834919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:49.958550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:49.966814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a3ad9120-5185-4bb8-ab59-29fd29280a35 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.144827 Aug 22 19:46:49.967376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1316/2478] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:49 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:49.982261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:49.982875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:49.988875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:49.989310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:49.989746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:49.990439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:49.990888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:49.991315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:50.050979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:50.053153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:50.060870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4fff7877-f1eb-4e7a-a109-78a7a4964a7b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082386 Aug 22 19:46:50.061434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1163/2479] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:49 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:50.529303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:50.529909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:50.536306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:50.536783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:50.537210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:50.537890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:50.538337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:50.538760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:50.599728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:50.600618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:50.601266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:50.607784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:50.608271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:50.608413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6b886ed1-6ed7-4e4f-bdb4-9879b09f734b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082999 Aug 22 19:46:50.608712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:50.609184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1317/2480] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:50 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:50.609408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:50.609861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:50.610288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:50.741104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:50.749224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67cb618a-5977-42f4-a96b-18a5e125f453 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153339 Aug 22 19:46:50.749786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1164/2481] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:50 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:50.987468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:50.988052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:50.994494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:50.994984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:50.995416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:50.996125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:50.996568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:50.996986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:51.082230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:51.082852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:51.089411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:51.089890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:51.090321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:51.091017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:51.091465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:51.091907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:51.128364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:51.136723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6f56cd1c-11e8-4bed-8160-5a4bce516c0f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153238 Aug 22 19:46:51.137292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1318/2482] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:50 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:51.154320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:51.162547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25bdbb1d-297f-44e1-b7f1-42371b601099 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084136 Aug 22 19:46:51.163105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1165/2483] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:51 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:51.629550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:51.630166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:51.636737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:51.637225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:51.637668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:51.638360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:51.638816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:51.639243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:51.701497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:51.703677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:51.711334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-94b34dd2-8446-4e26-a2bf-196c86bb1c3c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085633 Aug 22 19:46:51.711934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1319/2484] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:51 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:51.770124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:51.770752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:51.777850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:51.778331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:51.778766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:51.779455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:51.779942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:51.780368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:51.906868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:51.914965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3288c284-30d0-4fbb-a140-323fafe00336 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148749 Aug 22 19:46:51.915542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1166/2485] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:51 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:52.158064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:52.158615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:52.164553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:52.165033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:52.165465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:52.166149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:52.167143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:52.167569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:52.184389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:52.185006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:52.191218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:52.191728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:52.192162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:52.192908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:52.193357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:52.193776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:52.261427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:52.270185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4b0c48f-a532-42a8-bd1d-d75245df758b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.090144 Aug 22 19:46:52.270766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1167/2486] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:52 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:52.296257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:52.304721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7c950a07-f3d8-44c2-8a33-781d013334b3 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150615 Aug 22 19:46:52.305288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1320/2487] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:52 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:52.732501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:52.733143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:52.739022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:52.739508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:52.739973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:52.740665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:52.741120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:52.741547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:52.801428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:52.810021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19023803-60af-4bec-83c5-98a1e631b7d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081467 Aug 22 19:46:52.810584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1168/2488] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:52.936411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:52.937011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:52.943377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:52.943885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:52.944313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:52.944988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:52.945691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:52.946117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:53.075243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:53.083335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4b1b8f97-639b-46c4-9ed1-3d0dcac68134 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151361 Aug 22 19:46:53.083925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1321/2489] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:52 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:53.291062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:53.291597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:53.298021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:53.298505 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:53.298938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:53.299629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:53.300098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:53.300522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:53.325949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:53.326649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:53.332729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:53.333207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:53.333637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:53.334325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:53.334771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:53.335208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:53.362432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:53.371652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85c758bb-9708-4b4c-bb12-5fb0eae8a7ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084436 Aug 22 19:46:53.372244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1169/2490] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:53 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:53.472086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:53.480260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a93584d4-e3b1-4413-9b3c-d23a12ab94cb tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.158130 Aug 22 19:46:53.480885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1322/2491] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:53 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:53.831007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:53.831670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:53.838311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:53.838797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:53.839259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:53.839981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:53.840442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:53.840867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:53.901330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:53.909487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bcae8e6c-cb1d-4b83-93b9-667df83fa2a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082404 Aug 22 19:46:53.910055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1170/2492] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:54.104318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:54.105420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:54.111839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:54.112322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:54.112762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:54.113460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:54.113912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:54.114338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:54.243333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:54.252015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d65c0fa6-4b27-4cda-ae5f-6bd7018dd5a4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151565 Aug 22 19:46:54.252574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1323/2493] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:54 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:54.392780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:54.393309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:54.399205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:54.399716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:54.400149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:54.400829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:54.401276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:54.401693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:54.465783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:54.474078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa93f7e6-198a-44bf-b33a-fe517e209f5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085181 Aug 22 19:46:54.474634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1171/2494] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:54 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:54.501107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:54.501719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:54.507587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:54.508095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:54.508531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:54.509208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:54.509660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:54.510079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:54.635835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:54.644489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b09af0fa-d861-4169-90d8-ecadfc43c38b tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147131 Aug 22 19:46:54.644996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1324/2495] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:54 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:54.930587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:54.931211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:54.938225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:54.938713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:54.939210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:54.939874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:54.940330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:54.940758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:55.002980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:55.011266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ee8004e-39b1-426a-bddd-fbc25939b933 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084689 Aug 22 19:46:55.011869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1172/2496] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:55.273675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:55.274232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:55.281284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:55.282063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:55.282620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:55.283597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:55.284195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:55.284632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:55.420399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:55.428474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-97a89924-638e-4989-a358-3a9d52bd93d8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.158755 Aug 22 19:46:55.429048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1325/2497] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:55 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:55.495042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:55.495725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:55.501859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:55.502339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:55.502773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:55.503468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:55.503930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:55.504349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:55.564766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:55.573005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ed0a22f-4bed-4ab9-ae41-f2da03c81f96 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081814 Aug 22 19:46:55.574098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1173/2498] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:55 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:55.665698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:55.666316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:55.672209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:55.672685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:55.673120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:55.673797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:55.674247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:55.674670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:55.799184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:55.807478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5712a6c2-5e17-434d-b970-d0c2127bd477 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.145583 Aug 22 19:46:55.808105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1326/2499] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:55 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:56.032297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:56.032906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:56.039264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:56.039783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:56.040238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:56.040903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:56.041354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:56.041776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:56.103700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:56.112038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a29d6564-ff89-4804-a38b-1b44af09cbcd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083586 Aug 22 19:46:56.112612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1174/2500] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:56 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:56.449855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:56.450472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:56.457111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:56.457589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:56.458023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:56.458708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:56.459155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:56.459575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:56.583679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:56.592825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2e99bd79-610d-4224-8bf1-b8e74192a932 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146852 Aug 22 19:46:56.593396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1327/2501] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:56 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:56.594781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:56.595461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:56.601653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:56.601893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:56.602350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:56.603012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:56.603483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:56.603894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:56.666235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:56.674944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30c9af5a-a442-401f-accd-e5fdf322f940 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084580 Aug 22 19:46:56.675527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1175/2502] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:56 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:56.828468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:56.829030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:56.834973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:56.835747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:56.836180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:56.836861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:56.837310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:56.837731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:56.971318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:56.979464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c42646f7-4964-47db-9f77-a8022d4a5b9c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154945 Aug 22 19:46:56.980051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1328/2503] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:56 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:57.132763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:57.133321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:57.135566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:57.141273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:57.141754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:57.142189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:57.142882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:57.143329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:57.143769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:57.205674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:57.214091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c24549cf-4fd5-4642-8b98-4c6355b8c41c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085267 Aug 22 19:46:57.214658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1176/2504] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:57 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:57.614139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:57.614755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:57.621257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:57.621739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:57.622702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:57.623389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:57.623880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:57.624305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:57.695743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:57.696362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:57.702305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:57.702791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:57.703228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:57.703950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:57.704404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:57.704824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:57.754147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:57.762232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6382a36c-aba4-44da-a9bd-c66a5cc47254 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151991 Aug 22 19:46:57.763297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1329/2505] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:57 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:57.767233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:57.775226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0cbe715a-55de-452a-b0b5-b350d4581974 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083386 Aug 22 19:46:57.775984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1177/2506] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:57 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:58.001042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:58.001674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:58.007504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:58.008010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:58.008470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:58.009145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:58.009591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:58.010006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:58.235131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:58.235744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:58.241684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:58.242105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:58.242541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:58.244438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:58.244909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:58.245342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:58.298342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:58.306650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:58.307052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1f47bf87-dc11-440b-a5c5-bf104c3cd452 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.310276 Aug 22 19:46:58.307854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1330/2507] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:57 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:58.315041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99140ffd-8fd3-4f99-b74e-0f0149183441 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084550 Aug 22 19:46:58.315605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1178/2508] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:58 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:58.783251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:58.783904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:58.790550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:58.791087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:58.791541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:58.792251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:58.792700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:58.793116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:58.796246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:58.796859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:58.802776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:58.803257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:58.803717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:58.804407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:58.804858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:58.805283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:58.869150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:58.878162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47bbcf9e-3b2d-4660-a78d-934ecdcf5459 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085650 Aug 22 19:46:58.878736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1179/2509] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:58 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:58.920905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:58.928987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dd8c75eb-7bcd-43cf-9882-58a20962edc1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149551 Aug 22 19:46:58.929534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1331/2510] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:58 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:59.328005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:59.328732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:59.335577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:59.335804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:59.336225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:59.336354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:59.336668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:59.337359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:59.337813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:59.338237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:59.342062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:59.342542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:59.342980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:59.343686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:59.344139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:59.344565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:59.353167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:46:59.405196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:59.413600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-28b6f784-81a9-457f-8f69-2cf9376abeee tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082319 Aug 22 19:46:59.414161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1332/2511] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:59 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:46:59.469696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:59.477823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae9e6bad-9725-45be-adaa-688be73e12c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153779 Aug 22 19:46:59.478389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1180/2512] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:59 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:46:59.899970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:59.900582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:59.906547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:59.907019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:59.907446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:59.908159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:59.908600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:59.909018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:59.952266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:46:59.952998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:46:59.959049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:59.959612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:59.960157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:59.961122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:46:59.961577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:46:59.962002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:46:59.973519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:46:59.982428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0a9d41c5-1dc2-4425-a325-775f9af9308e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.086355 Aug 22 19:46:59.983004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1333/2513] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:59 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:00.090055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:00.098040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c280f306-b537-4886-9471-25ab4561583f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149775 Aug 22 19:47:00.098599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1181/2514] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:46:59 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:00.434415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:00.435902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:00.441605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:00.442089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:00.442526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:00.443217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:00.443692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:00.444121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:00.498844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:00.499450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:00.504918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:00.505976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:00.506461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:00.506897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:00.507594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:00.508094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:00.508521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:00.514156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c50ef513-3b95-47f5-848b-7d84008e7c50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083581 Aug 22 19:47:00.514891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1334/2515] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:00 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:00.639260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:00.647379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c8f5d9d-b85b-4783-b9c6-4e49507b9912 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152888 Aug 22 19:47:00.647980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1182/2516] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:00 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:01.003942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:01.004554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:01.010913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:01.011397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:01.011876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:01.012565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:01.013016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:01.013440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:01.073718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:01.082368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-db63525a-512d-4a34-a82a-958ce3853eaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082408 Aug 22 19:47:01.082928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1335/2517] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:00 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:01.119225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:01.119875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:01.126521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:01.126994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:01.127432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:01.128152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:01.128606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:01.129027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:01.254637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:01.262639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4fb4cb67-b802-4b18-b407-2d15b8f5ec41 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147275 Aug 22 19:47:01.263784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1183/2518] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:01 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:01.534361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:01.534897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:01.540996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:01.541484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:01.541921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:01.542607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:01.543062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:01.543486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:01.560225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:01.605945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:01.614431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-76e70fe2-e523-4e91-96a0-1c16c403bced tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084019 Aug 22 19:47:01.614983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1336/2519] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:01 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:01.667978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:01.668597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:01.675531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:01.676043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:01.676487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:01.677179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:01.677633 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:01.678066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:01.806806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:01.814948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0968b3e0-97bf-4a39-b2f9-98e7c57126c7 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150792 Aug 22 19:47:01.815514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1184/2520] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:01 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:02.103179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:02.103745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:02.110231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:02.110716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:02.111152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:02.111881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:02.112332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:02.112755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:02.175687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:02.183902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3d5d8c12-723f-418b-ab12-f44f9258e217 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084613 Aug 22 19:47:02.184463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1337/2521] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:02 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:02.284549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:02.285161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:02.291010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:02.291560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:02.292189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:02.292994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:02.293581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:02.294111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:02.434397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:02.443831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85044142-14d4-4b76-ada0-c99689985a00 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.163764 Aug 22 19:47:02.444392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1185/2522] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:02 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:02.635519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:02.636045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:02.642485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:02.642972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:02.643413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:02.644140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:02.644601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:02.645027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:02.706654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:02.714998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0384db3c-8dc9-4ec1-af8a-f2c86d5b51db tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083436 Aug 22 19:47:02.715554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1338/2523] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:02 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:02.836251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:02.836842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:02.843184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:02.843678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:02.844111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:02.844788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:02.845236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:02.845653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:02.971896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:02.980034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-030cf359-0290-4efc-be67-32bf6245454c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148176 Aug 22 19:47:02.980598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1186/2524] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:02 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:03.205208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:03.205824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:03.212060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:03.212540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:03.212975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:03.213662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:03.214117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:03.214541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:03.277829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:03.289754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d2bce4db-270f-41eb-944b-56d1d680a16a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.087291 Aug 22 19:47:03.290330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1339/2525] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:03 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:03.465879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:03.466400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:03.472900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:03.473383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:03.473822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:03.474509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:03.474961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:03.475429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:03.605884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:03.613927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2d0c7d0-44e8-4d4c-9c34-f48849140eb8 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152054 Aug 22 19:47:03.614494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1187/2526] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:03 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:03.736206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:03.736782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:03.743255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:03.743777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:03.744217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:03.744914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:03.745369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:03.745799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:03.806740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:03.815483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b9a9d1b6-bfc4-4d4d-aef2-7020892bd256 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083786 Aug 22 19:47:03.816078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1340/2527] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:03 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:04.000604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:04.001231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:04.007593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:04.008106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:04.008540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:04.009248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:04.009718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:04.010118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:04.136665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:04.144767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7a20f8e-d230-4197-a678-d05d65d31cfe tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148087 Aug 22 19:47:04.145329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1188/2528] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:03 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:04.310254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:04.310795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:04.316929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:04.317418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:04.317861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:04.318558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:04.319056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:04.319521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:04.382498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:04.390988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-170afb5c-f431-46ef-b412-478b2f326959 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084670 Aug 22 19:47:04.391545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1341/2529] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:04 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:04.635203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:04.635771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:04.642269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:04.642750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:04.643192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:04.643908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:04.644363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:04.644791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:04.836564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:04.837176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:04.844142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:04.844707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:04.845077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:04.845794 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:04.846249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:04.846677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:04.910839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:04.919328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-93bd470c-635d-4d0e-8921-288c3f33b97c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086877 Aug 22 19:47:04.919931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1342/2530] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:04 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:05.002478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:05.011109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-932cac75-246b-438c-9a9d-7312efa6358e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.379852 Aug 22 19:47:05.011690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1189/2531] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:04 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:05.165705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:05.166244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:05.172688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:05.173166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:05.173595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:05.174273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:05.174719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:05.175135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:05.300738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:05.308791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8fd5a5b6-0977-412c-9cd0-001b642b9738 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146927 Aug 22 19:47:05.309360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1343/2532] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:05 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:05.412315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:05.412970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:05.418960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:05.419382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:05.419862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:05.421241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:05.421703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:05.422130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:05.485579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:05.493640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ac2a331-a110-4367-afad-6f76e3e010c4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085156 Aug 22 19:47:05.494192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1190/2533] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:05 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:05.940946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:05.941589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:05.947958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:05.948442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:05.948882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:05.949567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:05.950021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:05.950446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:06.013408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:06.021454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bf375c84-4e9e-4de5-91ec-767ec7a787d3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085006 Aug 22 19:47:06.022014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1344/2534] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:05 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:06.032479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:06.033095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:06.039504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:06.040090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:06.040526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:06.041215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:06.041673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:06.042106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:06.167784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:06.176608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ebe0745-e9d1-4f8c-a549-eefe77d757f3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148093 Aug 22 19:47:06.177168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1191/2535] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:06 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:06.330985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:06.331598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:06.337803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:06.338277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:06.338737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:06.339420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:06.339893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:06.340318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:06.471734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:06.479852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-590045eb-4dba-42d3-80c0-c1ba133c35f8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153202 Aug 22 19:47:06.480413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1345/2536] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:06 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:06.516707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:06.517319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:06.523449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:06.523973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:06.524414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:06.525135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:06.525587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:06.526009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:06.588993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:06.597083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82c46238-aae4-4318-80be-6ae19b3fd058 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084851 Aug 22 19:47:06.597649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1192/2537] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:06 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:07.042614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:07.043254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:07.050169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:07.050647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:07.051079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:07.051904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:07.052368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:07.052777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:07.114332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:07.122581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0fd99a39-0fd3-4869-9b2e-410bb3699c82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083783 Aug 22 19:47:07.123149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1346/2538] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:07 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:07.198032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:07.198646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:07.205389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:07.205865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:07.206296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:07.206985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:07.207429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:07.207882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:07.334496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:07.345547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea8047f7-7771-4463-9cd2-21a648731b6c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151300 Aug 22 19:47:07.346134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1193/2539] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:07 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:07.500594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:07.501208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:07.507128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:07.507611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:07.508085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:07.508774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:07.509224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:07.509649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:07.617933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:07.618544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:07.624445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:07.624936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:07.625377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:07.626168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:07.626632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:07.627059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:07.640054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:07.648247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4bce248a-8d1f-4180-b82d-b43ca37f1ac9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151551 Aug 22 19:47:07.648879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1347/2540] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:07 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:07.688788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:07.696992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acaa3175-3fe7-4e95-8696-ed1c1bf4cd4b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082839 Aug 22 19:47:07.697558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1194/2541] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:07 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:08.143122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:08.143875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:08.150128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:08.150611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:08.151046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:08.151777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:08.152228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:08.152648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:08.213433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:08.221672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-76d51603-d233-47c8-9bea-2a2400ba037d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082511 Aug 22 19:47:08.222227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1348/2542] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:08 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:08.366804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:08.367417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:08.374544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:08.375028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:08.375467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:08.376281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:08.376737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:08.377163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:08.506775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:08.514897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-854e41ca-7817-40a3-9dc7-b6115f7bf28e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152338 Aug 22 19:47:08.515477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1195/2543] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:08 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:08.669906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:08.671137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:08.677002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:08.677478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:08.677913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:08.678595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:08.679043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:08.679465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:08.718336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:08.718975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:08.725008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:08.725489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:08.725918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:08.726607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:08.727140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:08.727620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:08.789618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:08.798796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-779723b5-f4e7-42d4-bf76-1a56b5e2c28d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083986 Aug 22 19:47:08.799696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1196/2544] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:08 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:08.806734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:08.815451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9e457346-021e-4c5c-bfc8-283e76712aea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149359 Aug 22 19:47:08.816041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1349/2545] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:08 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:09.242617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:09.244734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:09.251139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:09.251621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:09.252079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:09.252765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:09.253349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:09.253801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:09.256476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:09.314538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:09.322499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-37666992-b9b4-4690-b243-b061635f89a5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083667 Aug 22 19:47:09.327833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1197/2546] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:09 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:09.536007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:09.536630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:09.543020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:09.543503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:09.543972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:09.544662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:09.545116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:09.545543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:09.672800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:09.680881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4db1c21d-de95-4e25-bcfa-114829336b5b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148762 Aug 22 19:47:09.681442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1350/2547] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:09 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:09.820332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:09.820901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:09.827285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:09.827792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:09.828229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:09.828918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:09.829366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:09.829786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:09.837014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:09.837636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:09.843558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:09.844076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:09.844629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:09.845336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:09.845797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:09.846232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:09.892341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:09.900344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed6ea284-4a21-46f6-8652-bb005e21db2b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083952 Aug 22 19:47:09.900906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1198/2548] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:09 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:09.972805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:09.980954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-99aa0b2b-d257-4098-96e6-f0ffdd9d7643 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148041 Aug 22 19:47:09.981525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1351/2549] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:09 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:10.344035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:10.344648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:10.350680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:10.351164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:10.351608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:10.352322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:10.352775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:10.353225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:10.416619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:10.424728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c855899-6569-4b69-8db7-7dc0e02b1d9c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085354 Aug 22 19:47:10.425282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1199/2550] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:10.703203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:10.703924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:10.710677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:10.711154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:10.711585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:10.712421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:10.712870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:10.713293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:10.839141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:10.847370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b462e814-5fc5-42ef-bc91-233603edfc0a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148779 Aug 22 19:47:10.847957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1352/2551] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:10 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:10.921076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:10.921685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:10.928106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:10.928585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:10.929018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:10.929701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:10.930148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:10.930569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:10.992628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:11.001184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-179a99a0-84a8-43ff-8d7a-d5719624665a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083925 Aug 22 19:47:11.001901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1200/2552] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:10 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:11.003138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:11.003783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:11.009676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:11.010160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:11.010595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:11.011291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:11.011773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:11.012197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:11.016660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:11.144771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:11.152845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-68a63c33-3ca9-4fb7-afdd-42824d67b627 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154380 Aug 22 19:47:11.153405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1353/2553] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:10 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:11.445361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:11.445980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:11.452105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:11.452588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:11.453022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:11.453708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:11.454159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:11.454583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:11.515042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:11.523169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5923de13-8600-43db-9b99-1c2f68753363 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081694 Aug 22 19:47:11.523750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1201/2554] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:11 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:11.867667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:11.868297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:11.874795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:11.875286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:11.875772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:11.877233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:11.877821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:11.878359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:12.004855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:12.012881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-944ef4ea-8437-4443-970a-5331596135fe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149043 Aug 22 19:47:12.013437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1354/2555] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:11 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:12.021760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:12.022352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:12.028942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:12.029421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:12.029859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:12.030545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:12.030988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:12.031405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:12.091920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:12.099996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8d8d72f3-94e2-4ea7-a644-16ca802fb71c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081996 Aug 22 19:47:12.100560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1202/2556] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:12 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:12.174285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:12.174903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:12.180886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:12.181362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:12.181795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:12.182481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:12.182930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:12.183353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:12.312733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:12.321035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b34a997-addc-48d1-b2c2-b6bf0126ef38 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151154 Aug 22 19:47:12.321598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1355/2557] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:12 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:12.544327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:12.544972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:12.551662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:12.552149 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:12.552586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:12.553279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:12.553741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:12.554166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:12.617171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:12.625338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1bd038f3-5354-45ee-bb8d-6d3c875d0835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084902 Aug 22 19:47:12.625910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1203/2558] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:12 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:13.034559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:13.035178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:13.041613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:13.042103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:13.042545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:13.043239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:13.043722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:13.044159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:13.121067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:13.121690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:13.128694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:13.129187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:13.129632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:13.130339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:13.130800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:13.131228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:13.172585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:13.180875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-66c4a73e-7199-44eb-8a7c-f2cf358ab0c5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150706 Aug 22 19:47:13.181451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1356/2559] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:13.193136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:13.201492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a61685d2-f652-4165-a7d1-61564bb9160c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084253 Aug 22 19:47:13.202629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1204/2560] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:13.342005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:13.342581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:13.348717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:13.349195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:13.349632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:13.350368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:13.350870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:13.351292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:13.487544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:13.495808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-89bd4c6d-ae97-4438-9a7e-45a43a00b91a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.157799 Aug 22 19:47:13.496368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1357/2561] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:13 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:13.646277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:13.646809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:13.652685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:13.653187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:13.653615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:13.654292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:13.654741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:13.655191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:13.717342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:13.725877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25f37b5f-6cca-4456-92d5-b97c58e7047e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083477 Aug 22 19:47:13.726440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1205/2562] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:13 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:14.202951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:14.203547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:14.209978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:14.210722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:14.211157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:14.211873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:14.212326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:14.212750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:14.223343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:14.223983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:14.230382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:14.230867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:14.231306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:14.232029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:14.232513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:14.232933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:14.341864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:14.347616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:14.350891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7f4c0894-a304-4a36-90bc-baf6dd29024e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152225 Aug 22 19:47:14.351467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1358/2563] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:14 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:14.356054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6780421a-d9f0-4a85-97e7-748727827754 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.136444 Aug 22 19:47:14.356722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1206/2564] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:14.517810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:14.518540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:14.524447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:14.524933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:14.525371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:14.526062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:14.526518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:14.526941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:14.651633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:14.659747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0515bdb3-a8fd-4f31-ad08-b34106eafe5a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146381 Aug 22 19:47:14.660307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1359/2565] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:14 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:14.747013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:14.747627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:14.754061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:14.754549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:14.754992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:14.755715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:14.756175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:14.756608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:14.820751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:14.829552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48fe08e5-0b65-47c2-a34d-c16a457df687 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086494 Aug 22 19:47:14.830134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1207/2566] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:15.372960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:15.373699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:15.376545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:15.377163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:15.380560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:15.380857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:15.381292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:15.382036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:15.382533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:15.382951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:15.383517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:15.384048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:15.384484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:15.385179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:15.385635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:15.386064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:15.448405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:15.457099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-041b3726-4259-4183-a8fc-69b11824108a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084473 Aug 22 19:47:15.457752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1208/2567] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:15.515750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:15.523781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5f50c95e-4823-44a7-b6d6-5a15cc8d044d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154665 Aug 22 19:47:15.524337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1360/2568] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:15 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:15.680562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:15.681175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:15.687262 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:15.687786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:15.688229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:15.688920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:15.689373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:15.689796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:15.815450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:15.823586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-920d56d7-6eff-42e0-b39c-9c2fa99d27ea tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146835 Aug 22 19:47:15.824189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1209/2569] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:15 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:15.850271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:15.850890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:15.856805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:15.857290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:15.857728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:15.858422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:15.858874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:15.859298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:15.918978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:15.927028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eaf2ff54-7cfb-4fce-aeb4-b8ff15a63c97 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.080663 Aug 22 19:47:15.927588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1361/2570] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:16.478420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:16.479041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:16.485498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:16.485983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:16.486424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:16.487116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:16.487572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:16.488023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:16.545090 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:16.545892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:16.551798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:16.553046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:16.553585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:16.554128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:16.554871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:16.555414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:16.555908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:16.560077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd8a0bc0-2d7a-4f19-8ca5-f8c1727c3f97 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085531 Aug 22 19:47:16.560650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1210/2571] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:16 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:16.679954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:16.688719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b2b5b87a-c591-44ff-97a2-61be83200c5e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147487 Aug 22 19:47:16.689281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1362/2572] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:16 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:16.845937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:16.846468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:16.852447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:16.852928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:16.853363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:16.854052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:16.854505 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:16.854932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:16.954510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:16.955243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:16.957172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:16.962856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:16.963420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:16.963953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:16.964749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:16.965270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:16.965699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:16.985725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:16.993820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f9c4261-24aa-4c59-80a6-d10a31497607 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152338 Aug 22 19:47:16.994389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1211/2573] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:16 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:17.031203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:17.039412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-02933ad6-b934-42d4-a330-dc62a7c81fe0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088783 Aug 22 19:47:17.040002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1363/2574] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:16 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:17.581407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:17.582014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:17.588721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:17.589210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:17.589648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:17.590341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:17.590807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:17.591234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:17.651965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:17.661131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80ace76d-1129-467d-91af-277a603d3986 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083224 Aug 22 19:47:17.661695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1212/2575] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:17.709521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:17.710129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:17.716725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:17.717203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:17.718131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:17.718815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:17.719377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:17.719703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:17.897236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:17.906029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-007837d8-b101-4bca-b961-4bc022c258f0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.199793 Aug 22 19:47:17.906675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1364/2576] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:18.014893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:18.015827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:18.021663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:18.022141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:18.022575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:18.023376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:18.023857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:18.024280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:18.060732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:18.061395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:18.067987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:18.068487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:18.069043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:18.069903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:18.070372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:18.070806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:18.135785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:18.144941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-07f1048d-e2c0-4317-a51c-b6d52e14df4b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087979 Aug 22 19:47:18.145725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1365/2577] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:18 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:18.162847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:18.165082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:18.172430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a55f1c23-3013-42ab-afe6-760f358676b1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.161929 Aug 22 19:47:18.173006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1213/2578] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:18 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:18.682310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:18.682929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:18.689004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:18.689480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:18.689917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:18.690623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:18.691187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:18.691490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:18.755475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:18.763571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2bfee5b0-7cdf-4c4b-9f1c-4adc8e2fd5de tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085115 Aug 22 19:47:18.764150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1366/2579] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:18 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:18.926844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:18.927484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:18.934066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:18.934491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:18.934927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:18.935617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:18.936093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:18.937023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:19.065257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:19.073499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e261fac-d404-445f-9d2f-03c674b0065b tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150506 Aug 22 19:47:19.074104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1214/2580] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:18 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:19.166064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:19.166678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:19.173221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:19.173705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:19.174144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:19.174833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:19.175287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:19.175750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:19.193187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:19.193854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:19.199810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:19.200359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:19.200820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:19.201508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:19.201991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:19.202410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:19.236825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:19.244841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c82b9511-a223-4fa7-abc0-d6ca18c78de8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082661 Aug 22 19:47:19.245411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1367/2581] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:19.334031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:19.344669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d503e2ef-91c4-4ebf-a56d-fb74e06a1e8c tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.155333 Aug 22 19:47:19.345250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1215/2582] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:19 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:19.784607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:19.785245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:19.791603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:19.792112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:19.792543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:19.793247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:19.793676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:19.794095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:19.855596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:19.863816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-96bf014e-1559-4839-8d27-c56318c60a2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083018 Aug 22 19:47:19.864384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1368/2583] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:19 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:20.094822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:20.095438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:20.101845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:20.102321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:20.102750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:20.103428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:20.103902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:20.104331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:20.235793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:20.243990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d988ebc8-b9e0-453b-9ee0-8068a4a97bc3 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152994 Aug 22 19:47:20.244556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1216/2584] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:20 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:20.265759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:20.266368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:20.272361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:20.272845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:20.273284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:20.273976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:20.274431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:20.274854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:20.334964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:20.337440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:20.345572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9afb3b71-f952-4e15-ae40-99d34572abf8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084117 Aug 22 19:47:20.346143 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1369/2585] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:20 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:20.365389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:20.366001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:20.371995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:20.372485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:20.372895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:20.373581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:20.374641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:20.375057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:20.503876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:20.512302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7198c094-0183-4b52-a13b-82b506aaf077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150697 Aug 22 19:47:20.512858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1217/2586] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:20 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:20.885315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:20.885961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:20.892351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:20.892836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:20.893274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:20.893984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:20.894416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:20.894844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:20.954838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:20.963242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-29ddc2b7-484f-4ece-a1a6-2d0b5a15a05e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082078 Aug 22 19:47:20.963833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1370/2587] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:20 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:21.265641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:21.266241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:21.273023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:21.273500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:21.273934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:21.274614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:21.275061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:21.275478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:21.365954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:21.366594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:21.372591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:21.373079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:21.373518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:21.374748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:21.375200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:21.375634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:21.407784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:21.415947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65733292-1582-4283-b46a-6ad5a8ccfa8d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154747 Aug 22 19:47:21.416521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1218/2588] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:21 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:21.439028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:21.447381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fe6e86d4-a90e-417c-8043-34415571a3f9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085192 Aug 22 19:47:21.448006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1371/2589] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:21 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:21.531975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:21.532584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:21.538694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:21.539163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:21.539589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:21.540286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:21.540732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:21.541181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:21.668508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:21.677015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75714ee0-937b-477a-9b54-8ed248d261e8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148838 Aug 22 19:47:21.677575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1219/2590] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:21 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:21.983013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:21.984252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:21.990672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:21.991156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:21.991592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:21.992307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:21.992759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:21.993180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:22.053356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:22.061494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-35ae9afc-c00b-47c6-8de2-40292ab4da85 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082266 Aug 22 19:47:22.062061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1372/2591] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:21 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:22.437908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:22.438507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:22.445337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:22.445814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:22.446324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:22.447005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:22.447452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:22.447891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:22.468708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:22.469328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:22.475220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:22.475741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:22.476183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:22.476877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:22.477329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:22.477752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:22.538617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:22.547272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4e9c4d52-db4d-4fb9-83ab-8737a2cd60f5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082368 Aug 22 19:47:22.547853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1373/2592] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:22 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:22.581610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:22.590299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de7161b2-0a82-4b84-a082-f18f027d9f2f tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.156905 Aug 22 19:47:22.590871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1220/2593] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:22 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:22.698224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:22.698776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:22.704654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:22.705131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:22.705566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:22.706252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:22.706705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:22.707129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:22.838227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:22.846930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c449d4e0-b5d8-4e9b-840d-420249714420 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152597 Aug 22 19:47:22.847498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1374/2594] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:22 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:23.082587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:23.083119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:23.089333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:23.089812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:23.090247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:23.090929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:23.091371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:23.091818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:23.153336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:23.161574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70ac552a-305c-456c-a81a-c00e8b9be07a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082958 Aug 22 19:47:23.162138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1221/2595] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:23 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:23.568295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:23.568889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:23.575318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:23.575830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:23.576262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:23.577554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:23.578002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:23.578421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:23.611148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:23.611882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:23.618809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:23.619301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:23.619769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:23.620464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:23.620913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:23.621332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:23.639290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:23.647923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-040df6bc-4294-42a9-a637-939767c1ee47 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083465 Aug 22 19:47:23.648575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1375/2596] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:23 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:23.751282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:23.759477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9bdd670a-e4f1-412c-a134-765b59389872 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152192 Aug 22 19:47:23.760077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1222/2597] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:23 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:23.868355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:23.868969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:23.875736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:23.876220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:23.876660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:23.877347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:23.877797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:23.878223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:24.005528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:24.013691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-40cb8a63-385b-4dd4-a6a7-9bb1149da235 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149189 Aug 22 19:47:24.014271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1376/2598] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:23 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:24.182610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:24.183220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:24.189612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:24.190086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:24.190516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:24.191193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:24.191662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:24.192086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:24.252775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:24.260848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1bc1f4d-08de-4d61-aca7-a23498c8d551 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082071 Aug 22 19:47:24.261404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1223/2599] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:24 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:24.668493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:24.669049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:24.675380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:24.675898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:24.676337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:24.677024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:24.677478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:24.677905 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:24.741649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:24.749803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6eb0cdcf-8185-47a8-b795-ef3082ae2ed2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085248 Aug 22 19:47:24.750369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1377/2600] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:24.781525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:24.782152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:24.788625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:24.789113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:24.789557 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:24.790249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:24.790706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:24.791136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:24.921183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:24.929252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5bd1dc50-1ca7-40bf-9bc4-71c99d9c7c02 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152283 Aug 22 19:47:24.929818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1224/2601] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:24 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:25.034197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:25.034812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:25.040831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:25.041319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:25.041761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:25.042456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:25.042910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:25.043339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:25.168897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:25.177067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f674639e-0111-4914-b239-a92faeb1cb17 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146677 Aug 22 19:47:25.177581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1378/2602] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:25 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:25.281929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:25.282577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:25.288526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:25.289042 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:25.289480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:25.290174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:25.290625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:25.291051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:25.356074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:25.361576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc64d0c6-5353-42d7-8a13-512048e48c43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083471 Aug 22 19:47:25.362158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1225/2603] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:25 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:25.770266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:25.770915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:25.777374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:25.777859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:25.778317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:25.778993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:25.779450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:25.780435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:25.840375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:25.849040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-551268b8-c54d-4d54-a923-080f61276560 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082625 Aug 22 19:47:25.849617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1379/2604] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:25 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:25.950212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:25.950822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:25.953182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:25.958517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:25.959065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:25.959588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:25.960307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:25.961078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:25.961536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:26.093337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:26.101626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-838e0ecb-e863-45d9-bd17-16152d67f584 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155217 Aug 22 19:47:26.102195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1226/2605] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:25 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:26.198197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:26.198820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:26.205346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:26.205834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:26.206280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:26.206980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:26.207437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:26.207901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:26.337991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:26.346834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1df62b42-d933-4844-8cf9-123d814c63b4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152448 Aug 22 19:47:26.347400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1380/2606] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:26 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:26.382611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:26.383216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:26.389765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:26.390244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:26.390677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:26.391416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:26.391907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:26.392328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:26.454011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:26.462426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24b1a68e-b4f5-4fe1-ac7c-2a8e1037ccf0 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083774 Aug 22 19:47:26.462986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1227/2607] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:26 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:26.870058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:26.870679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:26.878282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:26.878828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:26.879292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:26.880007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:26.880458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:26.880882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:26.941047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:26.949364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0cfa4459-5fe1-4d3a-ad5f-1a184a336612 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083243 Aug 22 19:47:26.949938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1381/2608] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:26 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:27.122748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:27.123340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:27.130572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:27.131059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:27.131498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:27.132216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:27.132708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:27.133135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:27.260512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:27.268603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b98a325f-803c-4bb5-937a-30a88bf8713c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149866 Aug 22 19:47:27.269171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1228/2609] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:27 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:27.370596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:27.371212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:27.377621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:27.378049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:27.378473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:27.379168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:27.379666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:27.380089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:27.483926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:27.484537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:27.490715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:27.491191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:27.491660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:27.492341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:27.492789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:27.493209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:27.513463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:27.521815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-aad04eb1-4010-44c6-b227-1a978fd9cf6e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.155002 Aug 22 19:47:27.522395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1382/2610] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:27 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:27.556190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:27.564472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ceac8407-6063-4737-8de9-c594d8ff93db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084935 Aug 22 19:47:27.565034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1229/2611] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:27 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:27.969678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:27.970348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:27.976745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:27.977265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:27.977707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:27.978434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:27.978888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:27.979314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:28.042948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:28.053027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-28a19b1f-156e-484d-88aa-fcba1494391f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087113 Aug 22 19:47:28.053692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1383/2612] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:28.290062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:28.290680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:28.296884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:28.297468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:28.297909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:28.299146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:28.299603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:28.300056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:28.315679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:28.432516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:28.441297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86250db7-931d-4291-9d9c-4a8fc0d476d7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155159 Aug 22 19:47:28.441882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1230/2613] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:28 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:28.543249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:28.543935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:28.549884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:28.550364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:28.550802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:28.551492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:28.551996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:28.552411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:28.585943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:28.586595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:28.592506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:28.592985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:28.593676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:28.594120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:28.594658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:28.595045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:28.657365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:28.665646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2c7eb5f-e49b-4b6c-8fc2-77c7c1c7805d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083799 Aug 22 19:47:28.666224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1231/2614] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:28 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:28.682669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:28.691223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-26804a7e-280d-40c2-850e-1b65107354c5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151881 Aug 22 19:47:28.691807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1384/2615] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:28 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:29.075238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:29.075880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:29.082731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:29.083216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:29.083670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:29.084375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:29.084825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:29.085249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:29.146493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:29.154771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c99042e-bf26-4449-9724-3390c9dd57ca tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083353 Aug 22 19:47:29.155336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1232/2616] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:29 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:29.463433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:29.464156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:29.470723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:29.471204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:29.471637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:29.472351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:29.472829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:29.473260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:29.597337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:29.605486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7a6192a0-6bb5-4943-9c2b-1d7d9871a120 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146275 Aug 22 19:47:29.606049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1385/2617] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:29 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:29.686048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:29.686690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:29.693666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:29.694148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:29.694583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:29.695271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:29.695757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:29.696181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:29.712546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:29.713166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:29.719264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:29.719704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:29.720162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:29.720899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:29.721357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:29.721785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:29.737949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:29.762826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:29.771127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9901a273-9e08-4602-ad89-99f2e4038dd1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.088802 Aug 22 19:47:29.771725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1233/2618] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:29 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:29.856132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:29.864825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ea9197e3-74c8-4978-8d54-4a7a5ce26416 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.156514 Aug 22 19:47:29.865386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1386/2619] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:29 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:30.176524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:30.177127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:30.183038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:30.183516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:30.183985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:30.184666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:30.185114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:30.185535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:30.245804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:30.253844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d535858-c21f-4088-ae2d-c2b867f519d1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081924 Aug 22 19:47:30.254423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1234/2620] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:30.626263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:30.626867 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:30.633281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:30.633752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:30.634181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:30.634862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:30.635306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:30.635771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:30.761160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:30.769818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bb3bf8da-32d8-453c-9081-9432fa0c3be9 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147458 Aug 22 19:47:30.770381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1387/2621] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:30 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:30.791775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:30.792422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:30.798830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:30.799308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:30.799773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:30.800466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:30.800917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:30.801341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:30.861761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:30.869861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99886de2-b6db-416c-b3b9-dfd1ed5fa85c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081928 Aug 22 19:47:30.870429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1235/2622] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:30 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:30.886259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:30.886818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:30.893407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:30.893889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:30.894331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:30.895023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:30.895477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:30.895938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:31.024663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:31.032747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-33f5a3ff-e739-42a4-a8e7-2d01201bae00 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150494 Aug 22 19:47:31.033309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1388/2623] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:30 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:31.274357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:31.274970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:31.281046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:31.281552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:31.281974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:31.282661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:31.283113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:31.283540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:31.343627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:31.351770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-174780c2-5c8e-443d-a9b8-0b5ff145cbe6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081241 Aug 22 19:47:31.352336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1236/2624] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:31.790783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:31.791393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:31.797464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:31.797939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:31.798370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:31.799047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:31.799491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:31.799950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:31.892167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:31.892776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:31.899153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:31.899630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:31.900093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:31.900786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:31.901232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:31.901651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:31.926014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:31.934323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7ef17a7c-226f-43de-8c4c-e97c362907e5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147359 Aug 22 19:47:31.934900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1389/2625] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:31 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:31.967609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:31.975831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b52b5546-2a34-4135-898f-85891f3bf6fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.088047 Aug 22 19:47:31.976394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1237/2626] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:31 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:32.053950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:32.054490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:32.060396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:32.060871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:32.061305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:32.061986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:32.062432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:32.062852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:32.189778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:32.198359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-69929b72-2a0f-4fd0-a3e9-9415a453bdd4 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148910 Aug 22 19:47:32.198930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1390/2627] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:32 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:32.374272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:32.374800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:32.381036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:32.381512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:32.381947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:32.382633 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:32.383084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:32.383503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:32.444717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:32.452862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c1de0235-aed1-4f41-80ad-d578eef6c13c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083781 Aug 22 19:47:32.453428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1238/2628] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:32 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:32.955899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:32.956562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:32.963240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:32.963754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:32.964192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:32.964881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:32.965328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:32.965752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:32.997035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:32.997907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:33.005531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:33.006018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:33.006456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:33.007165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:33.007996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:33.008428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:33.070021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:33.078207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-28100eaf-6352-44cd-8f2a-b16dbded3d22 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084933 Aug 22 19:47:33.078784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1239/2629] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:32 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:33.097856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:33.105935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ff300515-665e-429e-b7b5-3dbf7ad5cc52 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153914 Aug 22 19:47:33.106501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1391/2630] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:32 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:33.219359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:33.219977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:33.226547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:33.227030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:33.227470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:33.228184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:33.228638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:33.229064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:33.356526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:33.365142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-24b10841-28a9-424d-b9d9-ff83d37b7d47 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149053 Aug 22 19:47:33.365698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1240/2631] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:33 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:33.473294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:33.474506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:33.480474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:33.480952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:33.481385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:33.482067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:33.482757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:33.482930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:33.545347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:33.553792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a7bea771-c62d-43c7-a539-f74afba43a66 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084425 Aug 22 19:47:33.554357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1392/2632] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:33 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:34.099037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:34.099609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:34.106119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:34.106603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:34.107039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:34.107763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:34.108222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:34.108654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:34.127380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:34.128103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:34.135072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:34.135673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:34.136117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:34.136805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:34.137253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:34.137672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:34.174306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:34.183121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-825434cf-815c-4354-84a6-3113a7ae9396 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.087936 Aug 22 19:47:34.183712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1241/2633] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:34 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:34.268478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:34.276569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-afe707b5-45e0-4d6f-864a-7f55096382f7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152961 Aug 22 19:47:34.277137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1393/2634] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:34 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:34.387043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:34.387606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:34.393662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:34.394131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:34.394561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:34.395241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:34.395716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:34.396138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:34.523182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:34.531951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e649fe5-7c83-4b10-931a-bcedb0c8e1b5 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148772 Aug 22 19:47:34.532536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1242/2635] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:34 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:34.574082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:34.574699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:34.580672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:34.581154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:34.581591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:34.582282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:34.582736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:34.583163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:34.644081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:34.652064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6e720404-79cf-4635-b79a-35789e56ccde tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081795 Aug 22 19:47:34.652621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1394/2636] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:35.203441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:35.204072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:35.211350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:35.211876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:35.212316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:35.213011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:35.213469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:35.213896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:35.274783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:35.283005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12358d36-33ac-4106-8a72-63855bc756ce tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083383 Aug 22 19:47:35.283572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1243/2637] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:35 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:35.297459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:35.298071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:35.304520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:35.304998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:35.305434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:35.306116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:35.306562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:35.306979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:35.432022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:35.440066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-06cb4755-eefd-4492-85d9-5027dbd881d5 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146347 Aug 22 19:47:35.440631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1395/2638] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:35 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:35.553578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:35.554183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:35.560060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:35.560538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:35.560965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:35.561643 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:35.562088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:35.562507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:35.673083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:35.673702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:35.680379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:35.680801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:35.681237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:35.681930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:35.682383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:35.682802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:35.695335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:35.704125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-02c3cc9a-d4c6-4b39-a456-9391168075ee tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.154330 Aug 22 19:47:35.704693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1244/2639] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:35 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:35.743347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:35.751774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cdba8fea-ecc8-43e9-80bb-7b49381d8f69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082595 Aug 22 19:47:35.752536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1396/2640] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:35 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:36.304688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:36.305295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:36.311634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:36.312143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:36.312577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:36.313266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:36.313709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:36.314161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:36.376133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:36.384677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80400e56-8cb3-4036-83a5-f69ac7298577 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084177 Aug 22 19:47:36.385245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1245/2641] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:36 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:36.462040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:36.462684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:36.469147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:36.469629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:36.470057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:36.470735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:36.471183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:36.471626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:36.607654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:36.616205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0313d20e-7016-4d83-9fc0-7d6f7a5c49c4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.158350 Aug 22 19:47:36.616774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1397/2642] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:36 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:36.725622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:36.726151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:36.732069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:36.732547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:36.732975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:36.733655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:36.734099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:36.734518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:36.773854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:36.774469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:36.780326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:36.780811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:36.781246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:36.781944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:36.782398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:36.782823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:36.844026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:36.852589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7f132224-752b-4ce8-a028-cac5fbe01904 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082465 Aug 22 19:47:36.853162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1398/2643] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:36.865724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:36.873877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06458a4e-e743-4aba-b7dd-d5cce06e7ca8 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.152122 Aug 22 19:47:36.874435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1246/2644] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:36 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:37.406246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:37.406788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:37.413582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:37.414061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:37.414501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:37.415186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:37.415637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:37.416081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:37.476223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:37.484379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-083730a8-9f15-446f-968c-7f5624a53ce7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082117 Aug 22 19:47:37.484943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1399/2645] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:37 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:37.636161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:37.636788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:37.643068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:37.643843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:37.644276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:37.644963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:37.645411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:37.645831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:37.648319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:37.776320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:37.784559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-28bef1c4-20c3-4e05-83af-52e996ff9446 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152244 Aug 22 19:47:37.785125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1247/2646] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:37 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:37.873822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:37.874549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:37.881673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:37.882330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:37.882670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:37.883525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:37.884009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:37.884446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:37.894411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:37.895079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:37.901539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:37.902017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:37.902448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:37.903134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:37.903579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:37.904032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:37.949956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:37.958493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2e96dc4e-ef97-4e4d-9c6c-4a6c7fafeac7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088476 Aug 22 19:47:37.959052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1400/2647] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:38.031606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:38.040423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9548986e-a243-47ca-9781-7f19c4258bb0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149876 Aug 22 19:47:38.040988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1248/2648] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:37 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:38.505557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:38.506180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:38.512992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:38.513474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:38.513911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:38.514599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:38.515051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:38.515477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:38.578278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:38.587700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-281d4341-fdb1-4ef8-bc23-5a027fbacd8b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.086399 Aug 22 19:47:38.588281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1401/2649] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:38 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:38.806621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:38.807205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:38.813799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:38.814285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:38.814723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:38.815416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:38.815898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:38.816330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:38.947000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:38.955069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-63405e71-7504-4b6b-bfdd-4594605e398e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152933 Aug 22 19:47:38.955632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1249/2650] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:38 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:38.980455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:38.981085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:38.986973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:38.987459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:38.987936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:38.988637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:38.989094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:38.989523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:39.049924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:39.058069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1ebd1384-07b4-4eb4-ba12-21d2d61b91ed tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081412 Aug 22 19:47:39.058578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1402/2651] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:39.060448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:39.061092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:39.067030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:39.068053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:39.068494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:39.069187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:39.069637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:39.070063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:39.198715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:39.206870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7426daf6-01fa-453c-b0c7-11639bd2a077 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150183 Aug 22 19:47:39.207437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1250/2652] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:39 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:39.608858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:39.609403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:39.616323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:39.616807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:39.617244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:39.617930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:39.618384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:39.618814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:39.622676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:39.679281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:39.687304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0adeedfb-80a0-4c2e-b28b-df3da33ed1f9 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082379 Aug 22 19:47:39.687930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1403/2653] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:39 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:39.977010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:39.977623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:39.984238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:39.984719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:39.985150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:39.985839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:39.986288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:39.986706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:40.080486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:40.081257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:40.088156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:40.088715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:40.089216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:40.089906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:40.090355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:40.090774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:40.114137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:40.122595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb4c9113-5731-4dd0-8fc9-4da9ec68f5ee tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149441 Aug 22 19:47:40.123180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1251/2654] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:39 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:40.153068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:40.161385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ce41aaed-b089-4318-83bb-3c29ae12a69a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084655 Aug 22 19:47:40.161953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1404/2655] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:40.228857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:40.229400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:40.235293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:40.235810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:40.236247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:40.236933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:40.237384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:40.237805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:40.367394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:40.375488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53948f4a-3853-4374-884b-75ff1b0cea0a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150481 Aug 22 19:47:40.376086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1252/2656] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:40 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:40.710358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:40.711292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:40.717673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:40.718146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:40.718579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:40.719261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:40.719743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:40.720165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:40.783444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:40.792003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-96987518-9d75-440d-b8b8-0e184f225e2e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.086087 Aug 22 19:47:40.792562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1405/2657] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:40 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:41.144024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:41.144584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:41.151425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:41.151931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:41.152365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:41.153049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:41.153493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:41.153912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:41.181532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:41.182145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:41.188308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:41.188880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:41.189375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:41.190165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:41.190681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:41.191204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:41.252864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:41.261547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-87171dbb-e3a9-4ab7-92a9-8860feed3428 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083805 Aug 22 19:47:41.262119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1406/2658] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:41.281782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:41.290867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06d63f95-5a2b-45c6-8ca2-e764f153abe1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150822 Aug 22 19:47:41.291425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1253/2659] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:41 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:41.397002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:41.397576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:41.403423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:41.403938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:41.404372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:41.405048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:41.405495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:41.405914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:41.532249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:41.540900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2aaed0b9-9d37-40d6-9df7-b78ca4b1cd7a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148447 Aug 22 19:47:41.541466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1407/2660] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:41 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:41.813079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:41.813715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:41.819738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:41.820221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:41.820658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:41.821343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:41.821792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:41.822215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:41.886284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:41.894414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0c1bed2-2b13-4814-a4d0-8bfd8acfdf92 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085164 Aug 22 19:47:41.894985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1254/2661] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:41 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:42.282215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:42.282824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:42.289213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:42.289692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:42.290123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:42.290804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:42.291248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:42.291687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:42.311559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:42.312220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:42.319231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:42.319750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:42.320195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:42.320898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:42.321358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:42.321788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:42.355350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:42.363675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-84948efc-669e-4a8a-a52a-d8b901442111 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085180 Aug 22 19:47:42.364268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1408/2662] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:42.449143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:42.457381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58db70f9-9593-49bb-9975-7c8970342b24 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149654 Aug 22 19:47:42.457949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1255/2663] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:42 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:42.562074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:42.562719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:42.569402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:42.569910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:42.570333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:42.571030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:42.571484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:42.571944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:42.703172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:42.711591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f6385432-3b2f-480b-9bcb-3925202ec3f1 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153430 Aug 22 19:47:42.712259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1409/2664] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:42 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:42.916199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:42.916729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:42.922684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:42.923164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:42.923602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:42.924315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:42.924767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:42.925192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:42.987391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:42.996116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5ff2f0a-c00d-4410-b34b-b6c1942f5647 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083807 Aug 22 19:47:42.996674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1256/2665] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:42 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:43.385294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:43.385892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:43.392810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:43.393336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:43.393781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:43.394487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:43.394945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:43.395521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:43.459047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:43.467502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0c4126f0-cde0-4952-8a4c-3ea02d90cc44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086321 Aug 22 19:47:43.468100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1410/2666] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:43.478494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:43.480377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:43.487067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:43.487540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:43.488005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:43.488773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:43.489843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:43.490271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:43.675716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:43.684613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86689dd7-a18e-4258-ace0-fe7dda7f881e tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.209888 Aug 22 19:47:43.685185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1257/2667] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:43 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:43.740711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:43.740711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:43.742601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:43.743081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:43.743521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:43.744368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:43.744957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:43.745499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:43.883627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:43.892004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-286b04d1-94d2-4cc5-90b9-641f6ba4027a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.164269 Aug 22 19:47:43.892571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1411/2668] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:43 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:44.016944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:44.017493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:44.023998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:44.024474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:44.024902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:44.025694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:44.026145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:44.026576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:44.087852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:44.096019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9918bac-6e22-4c3c-8f25-0c098c16c4f3 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083153 Aug 22 19:47:44.096597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1258/2669] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:44 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:44.490547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:44.491177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:44.497703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:44.498187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:44.498627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:44.499318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:44.499801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:44.500233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:44.560492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:44.569120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7d12ada4-df7a-45b5-8fc9-223a2fc4f70b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082397 Aug 22 19:47:44.569678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1412/2670] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:44 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:44.705959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:44.706571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:44.713241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:44.713717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:44.714152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:44.714829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:44.715281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:44.715722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:44.846789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:44.854831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-692aa101-51aa-4efc-9942-ef0304e2ec53 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152753 Aug 22 19:47:44.855393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1259/2671] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:44 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:44.912633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:44.913277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:44.915152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:44.920512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:44.921021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:44.921463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:44.922159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:44.922619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:44.923048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:45.050000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:45.058363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-53d63f0f-4565-4d85-8f7b-6b47ca700554 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149573 Aug 22 19:47:45.059074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1413/2672] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:44 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:45.117820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:45.118431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:45.124732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:45.125213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:45.125644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:45.126326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:45.126775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:45.127195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:45.188667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:45.197268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0cfc5fe4-bd4b-4820-a28b-3036f4355163 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083848 Aug 22 19:47:45.197830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1260/2673] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:45 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:45.590356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:45.590963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:45.597388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:45.597865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:45.598295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:45.599596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:45.600071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:45.600490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:45.663702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:45.672060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8281837f-e907-488b-98f0-1e23aa21ac9d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085538 Aug 22 19:47:45.672620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1414/2674] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:45 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:45.876080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:45.876840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:45.883827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:45.884312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:45.884746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:45.885433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:45.885888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:45.886311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:46.011566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:46.019808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50b13865-cce5-42d4-b3be-c5733898fddc tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147512 Aug 22 19:47:46.020367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1261/2675] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:45 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:46.079144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:46.079814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:46.086637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:46.087120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:46.087552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:46.088289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:46.088740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:46.089169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:46.215429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:46.218188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:46.218802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:46.223843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-52a87c64-0d60-4819-8653-578fd02fb151 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148419 Aug 22 19:47:46.224413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1415/2676] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:46 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:46.224758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:46.225320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:46.225793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:46.226496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:46.226952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:46.227381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:46.287998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:46.296077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d97f3736-4f5a-4673-b505-20d1a19c5271 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081627 Aug 22 19:47:46.296647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1262/2677] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:46 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:46.692366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:46.692963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:46.699265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:46.699782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:46.700227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:46.700922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:46.701367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:46.701787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:46.768129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:46.776120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4ee0490d-65c4-41d6-893e-1b8226fdea99 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087558 Aug 22 19:47:46.776675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1416/2678] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:47.042206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:47.042738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:47.049240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:47.049733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:47.050175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:47.050873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:47.051339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:47.051797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:47.185334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:47.187852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:47.195510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39ab4432-b22f-44de-91bc-749a2dbf7ebe tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.157234 Aug 22 19:47:47.196103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1263/2679] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:47 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:47.244737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:47.245792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:47.252242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:47.252801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:47.253305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:47.254064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:47.254691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:47.255291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:47.317359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:47.318424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:47.324835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:47.325326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:47.325762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:47.326480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:47.326980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:47.327410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:47.391906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:47.395057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:47.401945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9e1ad129-c539-43bd-be81-ccd55452535a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.160871 Aug 22 19:47:47.402648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1417/2680] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:47 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:47.403998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84d25a76-21c3-490c-9f75-42afdbbfe998 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.090567 Aug 22 19:47:47.410220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1264/2681] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:47 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:47.797404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:47.798011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:47.804548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:47.805027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:47.805492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:47.806201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:47.806657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:47.807078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:47.869104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:47.877330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-365bbeeb-8e1f-4663-a3d3-f16ee5c7e038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083781 Aug 22 19:47:47.878240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1418/2682] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:48.217386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:48.217999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:48.224373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:48.224852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:48.225287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:48.225969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:48.226426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:48.226846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:48.354863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:48.362981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5099c310-158f-4001-9411-3f176e88fd68 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149517 Aug 22 19:47:48.363541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1265/2683] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:48 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:48.423791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:48.423995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:48.424327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:48.424510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:48.430565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:48.430729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:48.431056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:48.431195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:48.431502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:48.431705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:48.432230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:48.432377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:48.432685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:48.432814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:48.433109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:48.433228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:48.494997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:48.503474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc8fcfd5-aed0-4b34-a0f5-a82b88e1dfe8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083251 Aug 22 19:47:48.504119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1266/2684] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:48 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:48.569458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:48.571661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:48.578556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-404428a7-6692-4219-a4ea-7c44e47e6aa9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.158492 Aug 22 19:47:48.579123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1419/2685] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:48 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:48.898926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:48.899532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:48.905503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:48.905977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:48.906443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:48.907086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:48.907534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:48.907980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:48.967996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:48.976056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c796dc7b-b225-42b3-ab39-3ff67cdf5709 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081507 Aug 22 19:47:48.980383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1267/2686] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:49.385111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:49.385950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:49.392183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:49.392660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:49.393094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:49.393786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:49.394235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:49.394655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:49.522708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:49.525122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:49.525746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:49.531196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2f541472-5a07-4fb0-88bf-c8d1005de674 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150579 Aug 22 19:47:49.532082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1420/2687] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:49 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:49.532227 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:49.532634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:49.533040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:49.533743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:49.534199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:49.534627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:49.596570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:49.600645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:49.601258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:49.605299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-edfd40a6-1733-473e-9845-6567dd1efd4f tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084751 Aug 22 19:47:49.605884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1268/2688] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:49 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:49.607246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:49.607836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:49.608338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:49.609092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:49.609656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:49.610094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:49.735980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:49.744879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6dd9bbce-47c1-4ad7-af90-92647e167b90 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148525 Aug 22 19:47:49.745452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1421/2689] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:49 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:49.996472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:49.997021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:50.002928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:50.003421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:50.003893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:50.004581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:50.005050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:50.005470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:50.069502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:50.077472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fecde117-daa3-41f8-8cfa-fa49d86c082e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084908 Aug 22 19:47:50.078039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1269/2690] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:50.552786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:50.553439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:50.560043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:50.560529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:50.560967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:50.561662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:50.562113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:50.562540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:50.626738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:50.627345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:50.634285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:50.634768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:50.635210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:50.635939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:50.636386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:50.636805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:50.694131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:50.699471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:50.702557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e220ac29-36ad-474f-838e-914c39f57ac7 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153634 Aug 22 19:47:50.703144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1422/2691] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:50 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:50.707536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9f144a6-2522-4d10-af81-03a81fb19215 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084583 Aug 22 19:47:50.708128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1270/2692] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:50 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:50.765925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:50.766572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:50.772581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:50.773098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:50.773541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:50.774273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:50.774732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:50.775159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:50.902768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:50.911033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5682f03d-5992-4b7b-abd3-10a9b1c37ff9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148961 Aug 22 19:47:50.911600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1423/2693] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:50 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:51.099738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:51.100264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:51.106177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:51.106656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:51.107093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:51.107811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:51.108271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:51.108696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:51.169656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:51.177839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91c47fef-180f-4f00-a123-51f513094b4c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082140 Aug 22 19:47:51.178407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1271/2694] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:51 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:51.724241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:51.724861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:51.727971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:51.728583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:51.731426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:51.731937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:51.732369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:51.733086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:51.733533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:51.733951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:51.734931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:51.735407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:51.735897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:51.736612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:51.737059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:51.737481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:51.799093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:51.807797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69a09709-6cbb-420e-a13b-58cb01238769 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083569 Aug 22 19:47:51.808544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1272/2695] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:51 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:51.862880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:51.871879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7ec0b702-09c1-4819-8f30-734bc0bce574 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151483 Aug 22 19:47:51.872438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1424/2696] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:51 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:51.931723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:51.932341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:51.938559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:51.939046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:51.939484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:51.940210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:51.940694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:51.941121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:52.069673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:52.077990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51ba8538-e883-46c1-80bc-c974d27882c0 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150070 Aug 22 19:47:52.078682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1273/2697] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:51 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:52.198686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:52.199298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:52.205303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:52.205781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:52.206213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:52.206892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:52.207339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:52.207787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:52.271095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:52.279241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-37265832-7b68-4760-922e-4258902bda82 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084466 Aug 22 19:47:52.279833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1425/2698] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:52.827592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:52.828230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:52.835233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:52.836041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:52.836474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:52.837154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:52.837605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:52.838023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:52.893434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:52.894047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:52.898422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:52.901092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:52.901575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:52.902010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:52.902702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:52.903151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:52.903569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:52.906457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4cf1b992-04f4-4486-8dbb-1dc4e80880dd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082719 Aug 22 19:47:52.907023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1274/2699] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:52 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:53.028105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:53.036243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1722d7e9-cddc-421a-b083-f0a3ac170085 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.146618 Aug 22 19:47:53.036801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1426/2700] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:52 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:53.100299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:53.100833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:53.106691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:53.107174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:53.107706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:53.108344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:53.108799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:53.109226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:53.236436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:53.244979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d907d65-1187-4bf1-a16e-61d0678b1736 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148781 Aug 22 19:47:53.245537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1275/2701] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:53 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:53.299056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:53.299685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:53.306108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:53.306592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:53.307030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:53.307744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:53.308205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:53.308628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:53.368230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:53.376337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b14a3d10-a4c2-4465-9b83-0b9519c214bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081021 Aug 22 19:47:53.376916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1427/2702] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:53.927813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:53.928430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:53.930739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:53.935933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:53.936415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:53.936853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:53.937540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:53.937989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:53.938412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:54.002445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:54.011324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ddcb5b5-ad4f-40af-80f3-fe54f91a65f4 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.087903 Aug 22 19:47:54.012341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1276/2703] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:53 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:54.022562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:47:54.023052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:47:54.056440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:54.057052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:54.063475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:54.063997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:54.064437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:54.065130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:54.065582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:54.066007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:54.194943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:54.203103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8f15edf9-4c2a-4138-a6b3-3c696cefab45 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151017 Aug 22 19:47:54.203680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1428/2704] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:54 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:54.266253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:54.266827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:54.273467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:54.273950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:54.274385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:54.275069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:54.275522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:54.275971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:54.398564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:54.399189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:54.401960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:54.405147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:54.405698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:54.406136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:54.406835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:54.407286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:54.407734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:54.410098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3bb03b9-d803-4f46-8eef-1f268328867f tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.147764 Aug 22 19:47:54.410666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1277/2705] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:54 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:54.473188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:54.482018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-22d73521-ccef-4f07-80ec-cf80ceb39362 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087892 Aug 22 19:47:54.482584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1429/2706] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:55.031815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:55.032428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:55.039439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:55.039958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:55.040401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:55.041096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:55.041560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:55.041983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:55.104568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:55.112976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13c0cba8-2978-4a03-9fea-108e73201424 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085003 Aug 22 19:47:55.113550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1278/2707] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:55 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:55.224788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:55.225432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:55.232000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:55.232477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:55.232908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:55.233590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:55.234036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:55.234455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:55.361506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:55.369750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-aac8a2e7-0070-4a05-8cc1-225278d95313 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.149379 Aug 22 19:47:55.370323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1430/2708] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:55 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:55.431267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:55.431932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:55.437772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:55.438245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:55.438675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:55.439380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:55.439850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:55.440269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:55.502579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:55.503231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:55.509665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:55.510148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:55.510586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:55.511286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:55.511766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:55.512190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:55.576621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:55.582697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:55.585326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8dfa801f-92df-495b-852e-e24a4220a64e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086654 Aug 22 19:47:55.586157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1431/2709] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:55 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:55.591839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a9ad339-4b7d-4b99-b9f6-4fe7a5868519 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.164360 Aug 22 19:47:55.592399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1279/2710] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:55 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:56.135451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:56.136025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:56.142085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:56.142555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:56.142983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:56.143695 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:56.144145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:56.144568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:56.205119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:56.213851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-58197bb8-7014-4aaf-b40b-ad01fbeca4e7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082324 Aug 22 19:47:56.214417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1432/2711] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:56 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:56.390430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:56.390997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:56.397957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:56.398432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:56.398865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:56.399544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:56.400018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:56.400439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:56.415017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:56.534163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:56.542156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf2cd4b9-3ee3-4ea5-bdc8-15dbe3886ce1 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.155689 Aug 22 19:47:56.542713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1280/2712] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:56 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:56.606099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:56.606719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:56.612108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:56.612917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:56.613603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:56.614101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:56.614671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:56.615297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:56.616373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:56.616802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:56.619434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:56.619942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:56.620374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:56.621061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:56.621511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:56.621962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:56.677668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:56.686623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d0cfb4b4-c785-4d76-b597-22936a1bcbd8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084355 Aug 22 19:47:56.687550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1433/2713] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:56 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:56.757210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:56.765362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3c5ec69-9d4a-41f4-b527-6d7c0c665121 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.157389 Aug 22 19:47:56.765928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1281/2714] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:56 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:57.234868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:57.235482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:57.242178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:57.242663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:57.243095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:57.243823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:57.244275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:57.244699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:57.309541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:57.317660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6df66f70-12a1-479a-903f-c9121d17d34c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.086765 Aug 22 19:47:57.318225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1434/2715] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:57 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:57.563598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:57.564218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:57.570669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:57.571146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:57.571577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:57.572289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:57.572738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:57.573166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:57.702203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:57.707002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:57.707799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:57.711302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f704250-df36-43a4-9f79-f495726ac73c tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151798 Aug 22 19:47:57.711908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1282/2716] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:57 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:57.715955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:57.716437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:57.716870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:57.717594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:57.718041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:57.718463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:57.782564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:57.785977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:57.786603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:57.790745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-daff12ad-73cd-4118-8111-42d1e037c572 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087598 Aug 22 19:47:57.791472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1435/2717] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:57 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:57.792569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:57.793071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:57.793500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:57.794230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:57.794682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:57.795110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:57.922610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:57.930868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fda3f0a0-aeb3-4049-8054-b86132db59e2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148777 Aug 22 19:47:57.931432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1283/2718] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:57 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:58.339089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:58.339723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:58.345712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:58.346187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:58.346615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:58.347299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:58.347773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:58.348190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:58.363165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:47:58.408793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:58.417540 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-72912693-fda7-4d48-a8f2-e545b730f725 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083093 Aug 22 19:47:58.418099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1436/2719] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:58 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:58.732554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:58.733172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:58.739295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:58.739798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:58.740236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:58.740921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:58.741374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:58.741796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:58.810767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:58.811371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:58.817751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:58.818234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:58.818672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:58.819913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:58.820869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:58.820987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:58.873544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:58.883121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57c99673-d11b-4419-bed2-2cfeefe3ac1a tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153901 Aug 22 19:47:58.883248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1284/2720] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:58 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:58.885147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:58.893196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-aba0b588-4c42-4b70-a141-217a1b235061 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086470 Aug 22 19:47:58.893745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1437/2721] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:58 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:47:58.951483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:58.952158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:58.958058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:58.958545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:58.958984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:58.960209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:58.960924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:58.961360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:59.088508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:59.097203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3fca685f-eb45-4cd6-8d4e-8fa0e466ecf9 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149177 Aug 22 19:47:59.098165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1285/2722] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:58 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:59.438395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:59.439012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:59.445559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:59.446039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:59.446472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:59.447158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:59.447608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:59.448054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:59.507631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:59.515850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2e0c8fac-5e2b-4ece-8919-3683dcef425e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081356 Aug 22 19:47:59.516414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1438/2723] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:59 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:47:59.903884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:59.904498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:59.911112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:59.911586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:59.912039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:59.912752 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:59.913198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:59.913334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:47:59.913759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:59.913926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:47:59.920478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:59.920961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:59.921399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:59.922127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:47:59.922706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:47:59.923161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:47:59.987917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:47:59.996253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c1af236c-ce41-40c6-88ba-4de5f4c5dd0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086690 Aug 22 19:47:59.996822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1439/2724] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:59 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:00.045979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:00.054100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e4c69bb-2ced-4779-bf8b-d78c9efbe195 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.154099 Aug 22 19:48:00.054680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1286/2725] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:47:59 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:00.118977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:00.119612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:00.125716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:00.126191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:00.126626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:00.127303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:00.127782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:00.128201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:00.253223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:00.261903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-321271fc-8afe-4a27-91fa-2905e8c2826a tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146763 Aug 22 19:48:00.262465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1440/2726] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:00 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:00.541900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:00.542510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:00.548475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:00.548948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:00.549376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:00.550058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:00.550503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:00.550926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:00.611673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:00.619626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbad9756-fa95-4aa9-aa21-767d4cb3f5df tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082189 Aug 22 19:48:00.620235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1287/2727] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:00 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:01.017403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:01.018002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:01.025034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:01.025513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:01.025943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:01.026624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:01.027076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:01.027597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:01.074872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:01.075501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:01.081912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:01.082399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:01.082833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:01.083520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:01.084332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:01.084501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:01.087376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:01.095587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9902728e-3ee6-495f-9dc9-9a733b41268a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082042 Aug 22 19:48:01.096182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1441/2728] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:01 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:01.211382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:01.219559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40c882f1-8ddb-4adc-a9ba-1cbcd7068842 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148483 Aug 22 19:48:01.220151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1288/2729] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:01 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:01.283366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:01.283943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:01.289770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:01.290245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:01.290689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:01.291350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:01.291834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:01.292251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:01.420015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:01.428783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dfa39f65-90e0-4f79-9592-d236a05653c6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148724 Aug 22 19:48:01.429344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1442/2730] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:01 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:01.641261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:01.641799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:01.648109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:01.648590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:01.649022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:01.649712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:01.650168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:01.650591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:01.711189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:01.719198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73932dd9-e348-437f-a5d7-bcab4e6ae60d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081855 Aug 22 19:48:01.719937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1289/2731] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:01 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:02.116696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:02.117310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:02.123233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:02.123747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:02.124184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:02.124945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:02.125402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:02.125820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:02.186088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:02.194187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6fd5e820-c4df-490a-8073-8ea56ae6c1fc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082010 Aug 22 19:48:02.194739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1443/2732] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:02 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:02.240571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:02.241224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:02.247718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:02.248199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:02.248626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:02.249302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:02.249744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:02.250161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:02.378715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:02.387255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58c095cb-db19-45a9-b408-b283ddedc8b0 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150584 Aug 22 19:48:02.387867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1290/2733] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:02 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:02.449457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:02.450106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:02.456491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:02.456974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:02.457411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:02.458098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:02.458548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:02.458972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:02.585292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:02.593610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6e4c311f-46cf-4f20-b75a-25f6ccfd0130 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148031 Aug 22 19:48:02.594169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1444/2734] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:02 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:02.740472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:02.741119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:02.747029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:02.747509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:02.747981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:02.748666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:02.749118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:02.749543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:02.814160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:02.822455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-955610e5-fa22-4dbf-bba6-777999b57f07 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085830 Aug 22 19:48:02.823026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1291/2735] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:02 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:03.215739 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:03.216352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:03.222276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:03.222759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:03.223197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:03.223912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:03.224369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:03.224798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:03.287352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:03.295510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1159aaad-a01e-4cf4-aceb-95e42936474c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083647 Aug 22 19:48:03.296100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1445/2736] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:03 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:03.410078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:03.410795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:03.417775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:03.418255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:03.418687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:03.419370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:03.419848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:03.420266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:03.550544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:03.558651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a2c29a9-64f1-4574-aa59-4238e8fa1721 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.153102 Aug 22 19:48:03.559225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1292/2737] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:03 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:03.614337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:03.614957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:03.621386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:03.621875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:03.622315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:03.623009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:03.623465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:03.623916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:03.748698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:03.757338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ae0aa2e3-b09d-4aed-8d3c-89cf76d12d3e tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.146926 Aug 22 19:48:03.757899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1446/2738] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:03 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:03.843828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:03.844442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:03.850333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:03.850813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:03.851249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:03.851963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:03.852421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:03.852841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:03.913449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:03.921797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9209ead6-c726-4183-b204-c55614b1bdaf tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.081896 Aug 22 19:48:03.922363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1293/2739] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:03 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:04.316262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:04.316876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:04.323466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:04.323980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:04.324416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:04.325100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:04.325554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:04.325980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:04.385320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:04.393421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f92588fe-868a-48f9-bbd2-9f8f7db8c356 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081068 Aug 22 19:48:04.393981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1447/2740] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:04 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:04.579208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:04.579847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:04.587148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:04.587630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:04.588091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:04.588779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:04.589232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:04.589655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:04.716040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:04.724219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11df7748-a661-4c37-b1cf-8cca60ec6680 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148919 Aug 22 19:48:04.724779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1294/2741] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:04 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:04.778769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:04.779422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:04.785920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:04.786404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:04.786863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:04.787537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:04.788021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:04.788451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:04.916671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:04.924727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-25db7b5b-abca-468c-8fd7-3191724dfd22 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149769 Aug 22 19:48:04.925292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1448/2742] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:04 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:04.942174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:04.942782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:04.950483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:04.950981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:04.951427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:04.952238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:04.952697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:04.953131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:05.015966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:05.024652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8dd50ca-c5d5-4cfd-8b13-3414e16fc385 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.086314 Aug 22 19:48:05.025215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1295/2743] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:04 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:05.414111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:05.414665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:05.420901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:05.421458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:05.421978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:05.422757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:05.423219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:05.423671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:05.484765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:05.492885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4f05d720-3029-4ada-9d8d-e348100df8da tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082917 Aug 22 19:48:05.493451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1449/2744] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:05 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:05.745346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:05.745964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:05.752527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:05.753013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:05.753449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:05.754143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:05.754596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:05.755028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:05.883316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:05.891456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1da86b29-24e1-497b-a60a-b58b4c5723d2 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150065 Aug 22 19:48:05.892045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1296/2745] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:05 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:05.946082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:05.946725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:05.953391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:05.953873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:05.954304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:05.954983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:05.955429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:05.955881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:06.044642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:06.045364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:06.051470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:06.051982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:06.052422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:06.053122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:06.053573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:06.053994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:06.058021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:06.085078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:06.094268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a18d236d-d784-4087-8032-01b3b9ab991d tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.151987 Aug 22 19:48:06.094845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1450/2746] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:05 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:06.116254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:06.124381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-597191dc-5752-419f-99f6-1fb328eed700 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083543 Aug 22 19:48:06.124943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1297/2747] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:06 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:06.514149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:06.514799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:06.520856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:06.521343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:06.521790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:06.522487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:06.522946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:06.523381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:06.586361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:06.594498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ec843e0d-5b9b-40bd-a69e-a4990c36c499 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084236 Aug 22 19:48:06.595064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1451/2748] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:06 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:06.912890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:06.913462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:06.920613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:06.921090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:06.921524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:06.922211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:06.922658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:06.923111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:07.052829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:07.061405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b21871f-dce2-4880-90d8-8e041b13c472 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.152474 Aug 22 19:48:07.061960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1298/2749] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:06 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:07.114686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:07.115307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:07.122528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:07.123007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:07.123438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:07.124229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:07.124765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:07.125191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:07.145154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:07.146022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:07.152977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:07.153565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:07.154070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:07.154835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:07.155357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:07.155889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:07.221829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:07.230464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2132e977-5a7c-4ca2-ba32-579637531706 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.089421 Aug 22 19:48:07.239819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1299/2750] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:07 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:07.466293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:07.474408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e1ae1e05-f1ee-4575-bdfe-7396a51162c2 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.363492 Aug 22 19:48:07.474917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1452/2751] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:07 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:07.614949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:07.615565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:07.622150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:07.622616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:07.623056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:07.623771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:07.624225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:07.624649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:07.685652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:07.693694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9788e3ab-40fb-4c45-a063-610a8d5df97b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082563 Aug 22 19:48:07.694260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1300/2752] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:07 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:08.082412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:08.083045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:08.089764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:08.090241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:08.090673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:08.091359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:08.091847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:08.092266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:08.094738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:08.217980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:08.226034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4b93c109-c745-43fc-94bb-2e8cbaba2549 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.147485 Aug 22 19:48:08.227175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1453/2753] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:08 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:08.251757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:08.252376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:08.259235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:08.259824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:08.260226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:08.260915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:08.261369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:08.261795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:08.323015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:08.331143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7eb683a9-d9e2-4313-8dd3-0b1201d7f5b6 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083246 Aug 22 19:48:08.331728 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1301/2754] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:08 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:08.496278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:08.496901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:08.502900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:08.503386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:08.503880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:08.504574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:08.505031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:08.505485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:08.633494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:08.641615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-60a82123-9aa0-4a52-8c5e-d360d0394981 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149424 Aug 22 19:48:08.642186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1454/2755] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:08 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:08.714430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:08.715046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:08.720966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:08.721443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:08.721879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:08.722593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:08.723044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:08.723466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:08.786923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:08.795281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79343d31-3841-4dc7-9e10-c828a292d2c2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084894 Aug 22 19:48:08.795876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1302/2756] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:08 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:09.247622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:09.248288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:09.254645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:09.255124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:09.255564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:09.256276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:09.256729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:09.257155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:09.352305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:09.352913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:09.359379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:09.359895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:09.360338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:09.361031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:09.361485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:09.361911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:09.386358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:09.394891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-334cc2f8-fc37-425c-a696-76f42dd2e4e4 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151085 Aug 22 19:48:09.395747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1455/2757] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:09 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:09.424051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:09.432736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-27803dcd-185b-459c-b474-2a821d837c41 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.084710 Aug 22 19:48:09.433304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1303/2758] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:09 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:09.663242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:09.663881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:09.670338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:09.670824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:09.671261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:09.672033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:09.672437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:09.672861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:09.800589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:09.808673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-11709fac-3397-4919-a26a-66b501133915 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149588 Aug 22 19:48:09.809237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1456/2759] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:09 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:09.816632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:09.817272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:09.823706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:09.824193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:09.824626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:09.825314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:09.825765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:09.826217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:09.886841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:09.895105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d7cebf60-6e8b-490c-8fc6-88b73f46db7d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082257 Aug 22 19:48:09.895690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1304/2760] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:09 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:10.416617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:10.417201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:10.423529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:10.424046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:10.424483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:10.425175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:10.425630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:10.426054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:10.453863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:10.454476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:10.461610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:10.462072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:10.462499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:10.463180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:10.463625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:10.464066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:10.526735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:10.535114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82a6844e-183f-4dd6-9228-55527a024661 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085008 Aug 22 19:48:10.535705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1305/2761] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:10 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:10.555556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:10.563803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-232e644a-e33c-4e26-b0a0-c6c27321892d tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151743 Aug 22 19:48:10.564358 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1457/2762] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:10 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:10.829858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:10.830473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:10.837155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:10.837630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:10.838056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:10.838737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:10.839186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:10.839600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:10.917116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:10.917728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:10.923813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:10.924299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:10.924735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:10.925428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:10.925878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:10.926296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:10.970796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:10.979535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a77638cc-5f31-421e-a8df-d9b2b8179adc tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.153490 Aug 22 19:48:10.980132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1306/2763] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:10 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:10.987633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:10.995714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fef71b6b-18a2-4dd3-9df9-7492dca5a56e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083056 Aug 22 19:48:10.996267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1458/2764] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:11.556162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:11.556777 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:11.563127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:11.563619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:11.564116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:11.564806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:11.565257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:11.565684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:11.585286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:11.586892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:11.593414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:11.593900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:11.594336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:11.595033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:11.595489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:11.595942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:11.627390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:11.636031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39a980d1-5fe9-4bea-af06-f273d2b461be tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083615 Aug 22 19:48:11.636600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1307/2765] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:11 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:11.724457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:11.733127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7ae540fb-d15c-4711-8fb2-35402f5387f6 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151661 Aug 22 19:48:11.733688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1459/2766] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:11 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:12.000493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:12.001117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:12.006934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:12.007409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:12.008396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:12.009082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:12.009529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:12.009948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:12.016576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:12.016972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:12.022613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:12.023098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:12.024181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:12.024883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:12.025339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:12.025769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:12.087362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:12.096184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5f4c652a-ab37-4743-b9e2-7d0520d8b493 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083787 Aug 22 19:48:12.096954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1460/2767] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:12 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:12.137534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:12.145802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a731098-19c8-4332-8646-8ada7f4da456 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.149122 Aug 22 19:48:12.146576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1308/2768] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:11 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:12.656286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:12.656870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:12.663249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:12.663766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:12.664774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:12.665450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:12.665896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:12.666313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:12.727800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:12.735950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d65570f8-f499-4d0c-b90b-4f493fc4b144 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.083423 Aug 22 19:48:12.736439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1461/2769] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:12 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:12.753991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:12.754722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:12.761757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:12.762236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:12.762662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:12.763340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:12.763867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:12.764289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:12.892473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:12.901195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e810ff30-e1d8-44c3-85cb-1318bd6fe670 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151043 Aug 22 19:48:12.901759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1309/2770] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:12 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:13.116817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:13.117942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:13.123980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:13.124459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:13.124896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:13.125591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:13.126045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:13.126503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:13.167463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:13.168753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:13.174931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:13.175416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:13.175882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:13.176576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:13.177024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:13.177443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:13.189720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:13.198335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a45d2f29-1abe-45e0-8be9-0a6c750bbd25 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085366 Aug 22 19:48:13.198964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1462/2771] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:13 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:13.305788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:13.313803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5ad5da9a-6c44-468c-9034-2e901dc301d6 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.150324 Aug 22 19:48:13.314361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1310/2772] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:13 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:13.755903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:13.756519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:13.759451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:13.764880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:13.765368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:13.765810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:13.766505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:13.766962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:13.767388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:13.828537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:13.837477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3db5d470-098b-4fb0-a73b-b108c321cec8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.085497 Aug 22 19:48:13.838036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1463/2773] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:13 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:13.921959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:13.922566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:13.928987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:13.929990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:13.930440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:13.931120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:13.931564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:13.932004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:14.061169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:14.069234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78fdf772-4a31-4225-ac6a-c7a973ef9798 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.151081 Aug 22 19:48:14.069793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1311/2774] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:13 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:14.220023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:14.220636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:14.226644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:14.227623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:14.228082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:14.228770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:14.229223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:14.229647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:14.290144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:14.298207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8dc8b211-2fb3-4379-ac15-b4b5f536675a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082025 Aug 22 19:48:14.298866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1464/2775] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:14.334073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:14.334681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:14.340961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:14.341437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:14.341863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:14.342549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:14.342997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:14.343415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:14.470813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:14.479195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efb0bd8b-ca8d-403d-9b77-682e6d168c76 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.148865 Aug 22 19:48:14.479780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1312/2776] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:14 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:14.858169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:14.858857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:14.865185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:14.865779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:14.866140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:14.866826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:14.867800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:14.868233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:14.927692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:14.936266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f483659e-a53b-4e3e-a338-725667e6483a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082055 Aug 22 19:48:14.936829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1465/2777] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:14 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:15.090859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:15.091515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:15.098056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:15.098542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:15.098978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:15.099693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:15.100151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:15.100578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:15.227955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:15.230113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:15.237622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b19739b-7113-4b12-84bc-8945e81d1171 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.150584 Aug 22 19:48:15.238195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1313/2778] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:15 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:15.318721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:15.319377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:15.325336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:15.325822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:15.326263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:15.326959 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:15.327417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:15.327973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:15.390774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:15.399464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e5d7e347-8a69-4737-b879-348b7f76ef0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083983 Aug 22 19:48:15.399993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1466/2779] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:15.500028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:15.500678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] [instance: 0b81f37d-80e6-429a-9afd-79fccb869bde] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:15.506580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:15.507067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:15.507513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:15.508243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:15.508702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:15.509133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:15.645355 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a0d600b1c42ec8fbb6710744bbd1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44cc7501b8ad41cc93825b4480d7c3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:15.654057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e50fd0c5-66aa-45ad-9e09-0e10d496e728 tempest-VolumesSnapshotTestJSON-226397738 tempest-VolumesSnapshotTestJSON-226397738-project] 10.222.0.61 "GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde" status: 200 len: 1560 microversion: 2.1 time: 0.157741 Aug 22 19:48:15.654554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1314/2780] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:15 2022] GET /compute/v2.1/servers/0b81f37d-80e6-429a-9afd-79fccb869bde => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:15.957458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:15.958073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:15.964828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:15.965308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:15.965748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:15.966436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:15.966889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:15.967313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:16.028124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:16.036187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-84331aa3-76f3-458a-9a16-54718ac1857e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.082611 Aug 22 19:48:16.036743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1467/2781] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:15 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:16.259382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:16.259949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:16.266489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:16.266976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:16.267463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:16.268193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:16.268640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:16.269065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:16.395433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:16.404333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0fea4f72-91cc-4a2b-a788-1b80fae59388 tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.148861 Aug 22 19:48:16.404911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1315/2782] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:16 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:16.420552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:16.421190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:16.427040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:16.427518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:16.427982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:16.428667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:16.429136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:16.429560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:16.489408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:16.497379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-56b050b5-e80f-487a-9009-25df880877e2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.080718 Aug 22 19:48:16.497941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1468/2783] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:16 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:16.812470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:16.812972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:16.818908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:16.819393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:16.819862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:16.820597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:16.821046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:16.821477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:16.846319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:48:16.922169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c2f18a0-cf43-4ecc-a75c-621d7732f101 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 204 len: 0 microversion: 2.1 time: 0.113166 Aug 22 19:48:16.922948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1316/2784] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:48:16 2022] DELETE /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:48:16.931103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:16.931767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:16.937941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:16.938432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:16.938872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:16.939562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:16.940038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:16.940470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:17.058571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:17.059309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:17.065688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:17.066181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:17.066620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:17.067045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:17.067510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:17.067918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:17.068345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:17.069235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:17.077155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-740e7b6f-2dc2-42e7-b4e5-fcb004707c04 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150297 Aug 22 19:48:17.077752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1469/2785] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:17.136574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:17.145383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07c95f9c-cbc8-4e53-9bf9-13a74f75a8aa tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 200 len: 1372 microversion: 2.1 time: 0.091576 Aug 22 19:48:17.146155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1317/2786] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:17.166149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b0eea9fa-55f2-4cc9-a6e1-6114307e6966 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '.version_select at 0x7f66e403faf0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:17.188821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b0eea9fa-55f2-4cc9-a6e1-6114307e6966 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680529348" status: 202 len: 0 microversion: 2.1 time: 0.026309 Aug 22 19:48:17.189385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1470/2787] 10.222.0.61 () {58 vars in 1221 bytes} [Mon Aug 22 19:48:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680529348 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:48:17.426138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:17.426779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] [instance: 9698a0b1-a98a-40e1-9093-39946273a155] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:17.433358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:17.433846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:17.434291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:17.434989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:17.435446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:17.435906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:17.518401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:17.519081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:17.525643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:17.526134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:17.526575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:17.527275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:17.527763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:17.528194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:17.591719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:17.600233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5c50a58b-121e-47e8-8dde-e4cadcf92b64 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085710 Aug 22 19:48:17.600826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1471/2788] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:17 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:17.865444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea80d48ea4a467d96ca9dfe2671bdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec13a665e661424fa8602f7fbd962e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:17.873894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db6c9e94-68c3-4316-b156-95f610137eba tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155" status: 200 len: 1602 microversion: 2.1 time: 0.451704 Aug 22 19:48:17.874457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1318/2789] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:17 2022] GET /compute/v2.1/servers/9698a0b1-a98a-40e1-9093-39946273a155 => generated 1602 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:17.894680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-86074398-a268-46c2-b003-9518f7b343cb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] Calling method '.version_select at 0x7f66df7fbee0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:17.913031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-86074398-a268-46c2-b003-9518f7b343cb tempest-TestMinimumBasicScenario-1618333595 tempest-TestMinimumBasicScenario-1618333595-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1884222474" status: 202 len: 0 microversion: 2.1 time: 0.022360 Aug 22 19:48:17.913602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1472/2790] 10.222.0.61 () {58 vars in 1272 bytes} [Mon Aug 22 19:48:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1884222474 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 19:48:18.102568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:18.102568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:18.106266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:18.107024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:18.108157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:18.109262 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:18.110033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:18.111378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:18.265982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:18.283615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aee47278-f704-4599-a23f-b2305674f7e9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.188918 Aug 22 19:48:18.291958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1319/2791] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:18.341881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ca1b0967-6fb6-47eb-86cc-b8994f293978 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: .version_select at 0x7f66e8015550>, body: {"keypair": {"name": "tempest-keypair-91703427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJaG8Cpxk/geDlUcg4x7/03r+CFBhhM9lQfh9vBZnbfBhNnLLSJRAKg+Z1JR7DfW7d0/l0HEg8BQrLZJa99J8nb1gwTd/Y3RXXYoY0OiMmQqb5ayuE8Sw0NaSd+rtwcBg=="}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:48:18.361083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-ca1b0967-6fb6-47eb-86cc-b8994f293978 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:48:18.365140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-ca1b0967-6fb6-47eb-86cc-b8994f293978 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for user 61388384a318473e987ab06426509b69 and project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:48:18.391399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ca1b0967-6fb6-47eb-86cc-b8994f293978 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.053921 Aug 22 19:48:18.395796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1473/2792] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 19:48:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:48:18.621928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:18.622593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:18.629506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:18.630163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:18.630701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:18.631590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:18.632098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:18.632523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:18.708923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:18.718600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-092924a1-b45d-4b16-a489-880ad52f2ecd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.101138 Aug 22 19:48:18.719181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1320/2793] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:18 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:19.310159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:19.310965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:19.317668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:19.318221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:19.318727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:19.319527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:19.320213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:19.321350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:19.545616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:19.555623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ebd293c6-4c30-484d-939f-db69561b7bdb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.248952 Aug 22 19:48:19.556473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1474/2794] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:19.746245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:19.746864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:19.748951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1501458448", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b9dcfeb-0136-4b6f-b975-7fb15dd06c27"}], "security_groups": [{"name": "tempest-securitygroup--5357866"}], "key_name": "tempest-keypair-91703427", "user_data": "}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:48:19.753658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:19.754148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:19.754582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:19.755274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:19.755748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:19.756371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:19.833344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:19.843690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e00b27e-29be-4d5a-9d3b-69a4ec993fce tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.106761 Aug 22 19:48:19.855665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1321/2795] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:19.866673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] validate_networks() for [('0b9dcfeb-0136-4b6f-b975-7fb15dd06c27', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:48:20.306394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:48:20.306828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:48:20.307355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:48:20.307787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:48:20.308202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:48:20.317185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:20.317885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:20.318324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:20.319052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:20.319506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:20.319957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:20.337785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:48:20.342409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for user 61388384a318473e987ab06426509b69 and project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:48:20.353506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:48:20.355843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:48:20.404126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e692596d-a6cb-41ba-ba02-ba165dc6b493 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.661563 Aug 22 19:48:20.404779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1475/2796] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:48:19 2022] POST /compute/v2.1/servers => generated 399 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 19:48:20.415763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d10dbff-8da6-4d0a-9f5e-6b9958b1f62c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:20.416667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9d10dbff-8da6-4d0a-9f5e-6b9958b1f62c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:20.424228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:20.527622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9d10dbff-8da6-4d0a-9f5e-6b9958b1f62c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:20.534715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d10dbff-8da6-4d0a-9f5e-6b9958b1f62c tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1240 microversion: 2.1 time: 0.123035 Aug 22 19:48:20.535586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1322/2797] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:20 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:20.577709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:20.578318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:20.584823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:20.585468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:20.586865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:20.589049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:20.589049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:20.589049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:20.733057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:20.741360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a0a3780d-9da4-4623-b435-2650a1a0a2f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.167949 Aug 22 19:48:20.741941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1476/2798] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:20.865308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:20.865975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:20.873063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:20.873552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:20.874211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:20.875177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:20.875850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:20.876450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:20.962806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:20.973119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f297b3d4-0110-41d2-9b7f-0ae44f74a935 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.111638 Aug 22 19:48:20.974055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1323/2799] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:20 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:21.555845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-207a001b-02ab-4035-b698-59061c91f2b2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:21.556473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-207a001b-02ab-4035-b698-59061c91f2b2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:21.615660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-207a001b-02ab-4035-b698-59061c91f2b2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:21.623147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-207a001b-02ab-4035-b698-59061c91f2b2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1240 microversion: 2.1 time: 0.071393 Aug 22 19:48:21.627700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1477/2800] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:21 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:21.763075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:21.763706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:21.769813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:21.770290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:21.770723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:21.771421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:21.771899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:21.772319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:21.908401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:21.916603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-59a8562d-bf6c-4fab-88cf-45062ba81391 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.157313 Aug 22 19:48:21.917172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1324/2801] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:21.994446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:21.995081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:22.001124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:22.001601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:22.002197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:22.003289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:22.004059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:22.004735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:22.066060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:22.074699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b69a27e9-5e24-4e0d-8eb3-990930f12e5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084117 Aug 22 19:48:22.075265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1478/2802] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:21 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:22.643915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c04fb7da-2d47-4f1d-b011-068de0721313 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:22.644535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c04fb7da-2d47-4f1d-b011-068de0721313 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:22.698157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c04fb7da-2d47-4f1d-b011-068de0721313 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:22.705045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c04fb7da-2d47-4f1d-b011-068de0721313 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1240 microversion: 2.1 time: 0.065026 Aug 22 19:48:22.705617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1325/2803] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:22 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:22.937619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:22.938230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:22.944673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:22.945151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:22.946239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:22.946956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:22.947442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:22.947957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:23.072796 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:23.080934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c2c35029-113f-4445-8c71-bfac58ea9726 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147268 Aug 22 19:48:23.081503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1479/2804] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:23.095918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:23.096568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:23.103073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:23.103548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:23.104015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:23.104696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:23.105143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:23.105562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:23.169335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:23.177457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a5ca1d8-7dad-473e-ae48-b6a674a798a7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085404 Aug 22 19:48:23.178016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1326/2805] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:23 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:23.727511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cfcc7e59-ccf2-43d1-82d2-160ddfad2f87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:23.728149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cfcc7e59-ccf2-43d1-82d2-160ddfad2f87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:23.783206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cfcc7e59-ccf2-43d1-82d2-160ddfad2f87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:23.790719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cfcc7e59-ccf2-43d1-82d2-160ddfad2f87 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1240 microversion: 2.1 time: 0.067672 Aug 22 19:48:23.791281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1480/2806] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:23 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:24.101565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:24.102105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:24.108534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:24.109020 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:24.109457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:24.110142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:24.110587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:24.111004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:24.198825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:24.199444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:24.205904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:24.206388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:24.206819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:24.207511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:24.208085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:24.208709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:24.241345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:24.249802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b32a5669-8110-4a64-8965-f30bc6a886ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152125 Aug 22 19:48:24.250388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1327/2807] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:24.271994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:24.281041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9a8a9498-ee28-41af-b175-d501da482b91 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086596 Aug 22 19:48:24.281603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1481/2808] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:24.812058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:24.812663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:24.818570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:24.819038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:24.819468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:24.820176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:24.820622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:24.821040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:24.880590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:24.888107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22fe40e4-0384-4fef-aaf1-79c77f22f570 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1244 microversion: 2.1 time: 0.079883 Aug 22 19:48:24.888673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1328/2809] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:24 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:24.949248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:48:24.949458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:48:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:48:25.272025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:25.272629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:25.279613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:25.280100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:25.280536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:25.281248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:25.282081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:25.282081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:25.301416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:25.302019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:25.309798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:25.310288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:25.310722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:25.311428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:25.311906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:25.312359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:25.378856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:25.387784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc04f4d4-c1ae-4dd7-8653-026268d78c78 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.090158 Aug 22 19:48:25.388703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1329/2810] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:25 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:25.436343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:25.446122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b09089c9-1039-4ad3-a399-4551a53ff0cc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.177574 Aug 22 19:48:25.446710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1482/2811] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:25.908365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:25.908972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:25.915828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:25.916312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:25.916745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:25.917438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:25.917884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:25.918305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:26.010326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:26.012523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:26.019344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad2b3ba9-cf38-4118-a9e3-3d006ccd374d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1298 microversion: 2.1 time: 0.114776 Aug 22 19:48:26.019949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1330/2812] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:25 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:26.413558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:26.415123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:26.421672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:26.422160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:26.422592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:26.423488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:26.424139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:26.424565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:26.467873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:26.477941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:26.484414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:26.488184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:26.488666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:26.489393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:26.500371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:26.500821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:26.523234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:26.541802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d02a6f90-4fd9-42d0-9f7a-3d81a6811fdf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.131084 Aug 22 19:48:26.543364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1483/2813] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:26 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:26.994630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:27.002700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07a440e2-33e2-45eb-81b5-47b3b3b58e55 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.539476 Aug 22 19:48:27.003282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1331/2814] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:27.041230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:27.041962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:27.047994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:27.049249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:27.049249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:27.049591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:27.050042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:27.050461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:27.195065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:27.203002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8a20c038-e961-4ca4-b767-f8500a1a44bc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1363 microversion: 2.1 time: 0.166064 Aug 22 19:48:27.203572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1484/2815] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:27 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:27.307536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9bada58f-496a-4d7a-b78f-758e41e30a85 req-7f7f05de-5805-4c7e-81b7-472ef7776114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0099938f-5131-4e40-a2d6-7100e471dc41", "tag": "c116450b-7b8e-4b99-bd93-f535d85ff625"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:48:27.318989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9bada58f-496a-4d7a-b78f-758e41e30a85 req-7f7f05de-5805-4c7e-81b7-472ef7776114 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:27.319608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9bada58f-496a-4d7a-b78f-758e41e30a85 req-7f7f05de-5805-4c7e-81b7-472ef7776114 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:27.320170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9bada58f-496a-4d7a-b78f-758e41e30a85 req-7f7f05de-5805-4c7e-81b7-472ef7776114 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:27.331379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9bada58f-496a-4d7a-b78f-758e41e30a85 req-7f7f05de-5805-4c7e-81b7-472ef7776114 service nova] Creating event network-changed:c116450b-7b8e-4b99-bd93-f535d85ff625 for instance 0099938f-5131-4e40-a2d6-7100e471dc41 on hv-cinder-83538 Aug 22 19:48:27.337219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9bada58f-496a-4d7a-b78f-758e41e30a85 req-7f7f05de-5805-4c7e-81b7-472ef7776114 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035164 Aug 22 19:48:27.337928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1332/2816] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:48:27.562350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:27.562985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:27.569619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:27.570104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:27.570549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:27.571250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:27.571727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:27.572158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:27.647072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:27.655893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7b886990-f7f6-44dd-a1f8-dffc8e25263f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.097345 Aug 22 19:48:27.656468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1485/2817] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:28.024723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:28.025534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:28.032089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:28.032574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:28.033005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:28.033697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:28.034148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:28.034569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:28.164464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:28.173206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b386f5fd-5842-49f5-a683-83e2e6c956f6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153170 Aug 22 19:48:28.173795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1333/2818] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:28.223917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:28.224563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:28.230471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:28.230951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:28.231386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:28.232102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:28.232557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:28.232979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:28.309148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:48:28.309310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:48:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:48:28.360961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:28.369088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-476d3047-fb8b-4604-9aaf-b11a09855cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1363 microversion: 2.1 time: 0.149156 Aug 22 19:48:28.369649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1486/2819] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:28 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:28.676627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:28.677354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:28.683998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:28.684483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:28.684922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:28.685608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:28.686058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:28.686486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:28.746652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:28.754754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b596bfb3-2217-4cea-846e-b4bde0d3343f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082038 Aug 22 19:48:28.755302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1334/2820] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:28 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:29.195854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:29.196463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:29.202782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:29.203256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:29.203713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:29.204395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:29.204842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:29.205261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:29.332900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:29.341946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-407ae491-789c-4e63-a45c-7caff7fbeffa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150408 Aug 22 19:48:29.346320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1487/2821] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:29 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:29.390103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:29.390713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:29.397614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:29.398041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:29.399095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:29.399825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:29.400282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:29.400710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:29.531166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:29.538671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a44e6a9-78a1-4e4f-86d8-187cf822006b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1363 microversion: 2.1 time: 0.152430 Aug 22 19:48:29.539222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1335/2822] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:29 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:29.780309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:29.780916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:29.786900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:29.787372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:29.787854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:29.788542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:29.789016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:29.789437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:29.853314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:29.861408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d690d571-4816-4c6b-a5f7-d7c31680892f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085002 Aug 22 19:48:29.861972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1488/2823] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:29 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:30.363677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:30.364233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:30.370412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:30.370902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:30.371342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:30.372070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:30.372528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:30.372960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:30.560701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:30.561383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:30.563785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:30.569873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:30.570364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:30.570802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:30.571500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:30.571976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:30.572402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:30.597236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:30.606688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47822c03-edec-4b94-9ed8-54d3d7204b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.246915 Aug 22 19:48:30.607575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1336/2824] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:30.704793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:30.713699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b75a1ea4-2a07-453a-8d12-d080f812f7c5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1363 microversion: 2.1 time: 0.156866 Aug 22 19:48:30.714274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1489/2825] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:30 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:30.881940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:30.882477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:30.888525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:30.888996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:30.889448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:30.890216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:30.890576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:30.890990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:30.952030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:30.960978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a67ba8a8-8813-41d6-8cba-001c236a718b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082741 Aug 22 19:48:30.961574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1337/2826] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:31.629305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:31.629921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:31.635972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:31.636454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:31.636891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:31.637581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:31.638031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:31.638457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:31.734145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:31.734754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:31.741485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:31.742013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:31.742973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:31.743699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:31.744152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:31.744572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:31.764016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:31.772329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f608fbce-0d30-481c-ab4b-9dff8298b237 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.146979 Aug 22 19:48:31.772830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1490/2827] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:31.874727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:31.882320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78db001d-48d2-41bc-8446-56d47714d247 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1363 microversion: 2.1 time: 0.151967 Aug 22 19:48:31.883029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1338/2828] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:31 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:31.982079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:31.982692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:31.988578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:31.989061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:31.989498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:31.990189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:31.990642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:31.991069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:32.052249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:32.060306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e3b6e8ca-b7a6-4119-9eb2-1cea8d0067f6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082039 Aug 22 19:48:32.060872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1491/2829] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:32.793620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:32.794234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:32.796098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:32.802019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:32.802508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:32.802954 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:32.803670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:32.804121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:32.804546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:32.902642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:32.903259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:32.909601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:32.910086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:32.910524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:32.911218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:32.911689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:32.912118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:32.916625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:32.931705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:32.940397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d99eb6e6-2376-444c-8d0b-3f5965c9c8c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151053 Aug 22 19:48:32.940895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1339/2830] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:33.043935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:33.051900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8c400abc-2655-4bc2-bc36-87766f20a71d tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1363 microversion: 2.1 time: 0.153562 Aug 22 19:48:33.052463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1492/2831] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:32 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:33.080628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:33.081240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:33.087944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:33.088429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:33.088868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:33.089560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:33.090014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:33.090436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:33.153255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:33.161741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a972cca-2fd4-4dd8-9b86-cb2ac89df0c6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085131 Aug 22 19:48:33.162513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1340/2832] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:33 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:33.962782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:33.963384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:33.965259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=14 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:33.970981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:33.971458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:33.971930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:33.972618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:33.973064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:33.973483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:34.072231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:34.072995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:34.079456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:34.080058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:34.080504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:34.081198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:34.081652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:34.082107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:34.100531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:34.109426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-17ea9b5d-118a-4c45-832b-efa940bd0e57 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150795 Aug 22 19:48:34.110311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1493/2833] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:34.182268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:34.182980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:34.188872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:34.189353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:34.189805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:34.190487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:34.190937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:34.191362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:34.213685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:34.221696 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-802b79ad-80c3-4486-9fa7-601849329ad5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1363 microversion: 2.1 time: 0.153340 Aug 22 19:48:34.222361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1341/2834] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:34 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:34.252292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:34.260233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-40e534b5-c4a9-4445-a589-39638ccce24a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081802 Aug 22 19:48:34.260787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1494/2835] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:34 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:34.671815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-58cfd435-9f06-4512-9de1-25b5782d43c1 req-afb61248-99f6-47a1-8a24-a9b8c2d567de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0099938f-5131-4e40-a2d6-7100e471dc41", "name": "network-vif-plugged", "status": "completed", "tag": "c116450b-7b8e-4b99-bd93-f535d85ff625"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:48:34.681270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-58cfd435-9f06-4512-9de1-25b5782d43c1 req-afb61248-99f6-47a1-8a24-a9b8c2d567de service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:34.681751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-58cfd435-9f06-4512-9de1-25b5782d43c1 req-afb61248-99f6-47a1-8a24-a9b8c2d567de service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:34.682243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-58cfd435-9f06-4512-9de1-25b5782d43c1 req-afb61248-99f6-47a1-8a24-a9b8c2d567de service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:34.693263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-58cfd435-9f06-4512-9de1-25b5782d43c1 req-afb61248-99f6-47a1-8a24-a9b8c2d567de service nova] Creating event network-vif-plugged:c116450b-7b8e-4b99-bd93-f535d85ff625 for instance 0099938f-5131-4e40-a2d6-7100e471dc41 on hv-cinder-83538 Aug 22 19:48:34.698745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-58cfd435-9f06-4512-9de1-25b5782d43c1 req-afb61248-99f6-47a1-8a24-a9b8c2d567de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087183 Aug 22 19:48:34.699395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1342/2836] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:48:35.130305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:35.130920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:35.137563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:35.138046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:35.138486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:35.139176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:35.139632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:35.140100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:35.243368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:35.244175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:35.250251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:35.250805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:35.251328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:35.252126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:35.252650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:35.253137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:35.272583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:35.281997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e2f7b4be-eb5d-43eb-a843-7a2ac9f138c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155537 Aug 22 19:48:35.282573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1495/2837] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:35.286976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:35.287744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:35.290484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:35.294316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:35.294808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:35.295249 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:35.295982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:35.296438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:35.296866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:35.360112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:35.368300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8c2c0ca2-152f-4f30-ae78-7f4a301da901 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084733 Aug 22 19:48:35.368876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1496/2838] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:35 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:35.389548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:35.397174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6ef02da-fec9-4538-90da-47263fba264a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1363 microversion: 2.1 time: 0.158577 Aug 22 19:48:35.397732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1343/2839] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:35 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:36.303409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:36.304053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:36.311026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:36.311512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:36.311998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:36.312692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:36.313152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:36.313583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:36.389441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:36.390111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:36.396586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:36.397010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:36.397445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:36.398168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:36.398623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:36.399050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:36.442475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:36.458690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-889a6dc6-e52c-4522-85a8-6f5193a40c21 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158957 Aug 22 19:48:36.463503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1497/2840] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:36.472551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:36.474010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:36.482515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:36.485784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:36.486650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:36.487394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:36.489281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:36.490274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:36.490820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:36.494341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38f97764-3f1b-4ac2-9a6f-3eff9f1becc5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.108757 Aug 22 19:48:36.495351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1344/2841] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:36.637603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:36.645350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f3837d0f-35f9-4706-b22d-aa4105a302fd tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1553 microversion: 2.1 time: 0.180062 Aug 22 19:48:36.645918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1498/2842] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:36 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:36.665642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8601a252-82d0-48e5-b3d9-efaf5875beae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:36.666064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8601a252-82d0-48e5-b3d9-efaf5875beae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:36.672039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8601a252-82d0-48e5-b3d9-efaf5875beae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:36.672524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8601a252-82d0-48e5-b3d9-efaf5875beae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:36.672961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8601a252-82d0-48e5-b3d9-efaf5875beae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:36.673654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8601a252-82d0-48e5-b3d9-efaf5875beae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:36.674106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8601a252-82d0-48e5-b3d9-efaf5875beae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:36.674529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8601a252-82d0-48e5-b3d9-efaf5875beae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:36.750781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8601a252-82d0-48e5-b3d9-efaf5875beae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089107 Aug 22 19:48:36.751376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1345/2843] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Aug 22 19:48:36 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:48:37.498010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:37.498627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:37.504992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:37.505471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:37.505903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:37.506583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:37.507150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:37.507575 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:37.521350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:37.522466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:37.528736 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:37.529231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:37.529723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:37.531118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:37.531582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:37.532073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:37.624326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:37.633611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1fffc1b-4dce-4d39-831f-2af6d4012912 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.116069 Aug 22 19:48:37.634483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1346/2844] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:37.650623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:37.659391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c32791fe-2afe-41d9-bac6-fc53166aef3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.165201 Aug 22 19:48:37.662657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1499/2845] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:37.700321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-add8e5bc-ee70-4992-8607-048ebcdd365e req-4be9bb10-27be-4910-aed0-ca069b7bf5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0099938f-5131-4e40-a2d6-7100e471dc41", "tag": "c116450b-7b8e-4b99-bd93-f535d85ff625"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:48:37.709693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-add8e5bc-ee70-4992-8607-048ebcdd365e req-4be9bb10-27be-4910-aed0-ca069b7bf5e2 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:37.710186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-add8e5bc-ee70-4992-8607-048ebcdd365e req-4be9bb10-27be-4910-aed0-ca069b7bf5e2 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:37.710895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-add8e5bc-ee70-4992-8607-048ebcdd365e req-4be9bb10-27be-4910-aed0-ca069b7bf5e2 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:37.722711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-add8e5bc-ee70-4992-8607-048ebcdd365e req-4be9bb10-27be-4910-aed0-ca069b7bf5e2 service nova] Creating event network-changed:c116450b-7b8e-4b99-bd93-f535d85ff625 for instance 0099938f-5131-4e40-a2d6-7100e471dc41 on hv-cinder-83538 Aug 22 19:48:37.728264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-add8e5bc-ee70-4992-8607-048ebcdd365e req-4be9bb10-27be-4910-aed0-ca069b7bf5e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032269 Aug 22 19:48:37.728859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1347/2846] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:48:38.654733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:38.655306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:38.661727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:38.662214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:38.662655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:38.663367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:38.663837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:38.664262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:38.681670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:38.682463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:38.689247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:38.689998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:38.690770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:38.691483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:38.692133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:38.693159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:38.734106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:38.744921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8ad7913d-ddb7-4ff5-b1da-041eb8da9e00 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.094076 Aug 22 19:48:38.745766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1500/2847] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:38.827085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:38.835164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60395b61-d5ab-496f-9bc2-69e14589e240 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158771 Aug 22 19:48:38.836018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1348/2848] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:39.765716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:39.766333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:39.772865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:39.773354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:39.774428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:39.775125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:39.775590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:39.776047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:39.835941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:39.844543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-38dfd63b-fb27-4d04-8fbc-bad4bdcdb422 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082617 Aug 22 19:48:39.845049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1501/2849] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:39 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:39.856270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:39.856889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:39.863440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:39.863961 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:39.864396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:39.865078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:39.865532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:39.865955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:39.995003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:39.997288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:40.004379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5eb9f561-81ff-4308-9a75-3d3bc14b4d0f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151872 Aug 22 19:48:40.004949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1349/2850] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:40.864294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:40.864903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:40.871269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:40.871777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:40.872215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:40.872899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:40.873345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:40.873789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:40.933578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:40.941507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1a05343c-9729-470a-9d3a-813f89049c2d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081027 Aug 22 19:48:40.942068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1502/2851] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:41.026164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:41.026775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:41.033216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:41.033931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:41.034372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:41.035053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:41.035500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:41.035947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:41.162225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:41.171181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb0d6ced-f53a-42ae-89eb-b7207f79cf2e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149342 Aug 22 19:48:41.171770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1350/2852] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:41.963155 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:41.963795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:41.970270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:41.970750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:41.971186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:41.971908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:41.972361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:41.972779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:42.032629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:42.040701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d043d89a-68a5-4be1-99d7-fac8158c880a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082396 Aug 22 19:48:42.041254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1503/2853] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:42.192312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:42.192925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:42.199806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:42.200290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:42.200730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:42.201412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:42.201864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:42.202288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:42.330500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:42.339060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c7dacbd3-2aa7-4bde-b150-cf6188011015 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150586 Aug 22 19:48:42.339637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1351/2854] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:43.062425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:43.063013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:43.069361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:43.069836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:43.070266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:43.071615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:43.072081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:43.072503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:43.138668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:43.147113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f83b6efc-c739-42f3-bf17-bab150f7012c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088998 Aug 22 19:48:43.147703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1504/2855] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:43.360211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:43.360790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:43.367253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:43.367770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:43.368210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:43.368896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:43.369348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:43.369772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:43.496717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:43.504836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b9998fc-0b04-4f70-8bda-4957241694e1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148559 Aug 22 19:48:43.505403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1352/2856] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:43 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:44.167423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:44.168069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:44.174500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:44.174981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:44.175415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:44.176141 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:44.176588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:44.177009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:44.237455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:44.246211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b82357e9-e742-4cca-99ab-e0dd48fb3148 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082593 Aug 22 19:48:44.246785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1505/2857] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:44 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:44.526282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:44.527003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:44.533561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:44.534040 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:44.534478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:44.535169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:44.535613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:44.536129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:44.624798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:48:44.625057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:48:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:48:44.993120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:45.001623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b36b5b33-41dd-414f-8287-f178e5f8ee00 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.479173 Aug 22 19:48:45.002288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1353/2858] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:45.266710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:45.267268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:45.274619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:45.275109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:45.275549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:45.276302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:45.276769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:45.277180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:45.337416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:45.345653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3998329b-9f6a-4d86-98b9-efbd99891d6a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082855 Aug 22 19:48:45.346240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1506/2859] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:45 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:46.023386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:46.024138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:46.030593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:46.031070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:46.031501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:46.032283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:46.032733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:46.033153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:46.160580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:46.169338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c42b56cc-3d2e-4322-8b29-6fb31b649192 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149923 Aug 22 19:48:46.169900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1354/2860] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:46.366702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:46.367299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:46.373677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:46.374157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:46.374591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:46.375271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:46.375749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:46.376194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:46.435934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:46.444145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4635108f-d23d-4649-a99f-fe1997eed373 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081277 Aug 22 19:48:46.444708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1507/2861] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:47.190265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:47.190882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:47.197883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:47.198391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:47.198825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:47.199512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:47.199992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:47.200418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:47.329466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:47.338671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bef8b343-38b3-40b3-9493-6518149d5fac tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152406 Aug 22 19:48:47.339233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1355/2862] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:47.465881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:47.467311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:47.474027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:47.474829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:47.475522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:47.476416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:47.476948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:47.477466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:47.544398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:47.550881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:47.556542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-43ac4113-d17b-4bee-aff1-462c34865450 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.094935 Aug 22 19:48:47.557367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1508/2863] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:48.359080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:48.359718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:48.366117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:48.366603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:48.367039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:48.368265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:48.368718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:48.369143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:48.499570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:48.508344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2e8804a9-a5b3-40d2-a8d2-d9c992086a86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153357 Aug 22 19:48:48.510936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1356/2864] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:48.578203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:48.578815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:48.585315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:48.586055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:48.586517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:48.587199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:48.587672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:48.588117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:48.649486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:48.666205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5f32fa9e-ef5a-4059-a1f6-38293c5d1a22 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.092082 Aug 22 19:48:48.666943 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1509/2865] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:49.531370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:49.532013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:49.538364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:49.538841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:49.539273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:49.539986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:49.540438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:49.540854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:49.668440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:49.677356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-23994e5b-1a6c-4048-a918-00968912ae9c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149892 Aug 22 19:48:49.677919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1357/2866] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:49.686829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:49.687438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:49.693811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:49.694289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:49.694721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:49.695401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:49.696476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:49.696902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:49.757810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:49.766399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-99c4b2e2-2084-450d-b731-42d5c9d06728 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083326 Aug 22 19:48:49.766965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1510/2867] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:50.698848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:50.699493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:50.701801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=74 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:48:50.707150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:50.707625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:50.708085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:50.708769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:50.709215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:50.709632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:50.787206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:50.787906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:50.794340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:50.794836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:50.795279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:50.796019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:50.796480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:50.796913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:50.844731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:50.853441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8777da79-246c-400b-bbbb-0acf4ccb221a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158980 Aug 22 19:48:50.854032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1358/2868] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:50.869017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:50.877708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6962aa42-2d32-4eaf-9ba2-913793430696 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.094334 Aug 22 19:48:50.878274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1511/2869] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:50 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:51.874856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:51.875473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:51.881916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:51.882403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:51.882849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:51.883546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:51.884046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:51.884975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:51.898208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:51.898910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:51.905894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:51.906381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:51.906820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:51.907517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:51.907999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:51.908425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:51.972321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:51.980674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b4657aa6-1c0c-4c77-bfe4-9a5830a40e44 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086253 Aug 22 19:48:51.981263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1512/2870] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:51 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:52.014420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:52.022519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d17c76c2-5b5c-4a70-848d-b11e41922630 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151526 Aug 22 19:48:52.023089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1359/2871] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:53.001144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:53.001782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:53.008241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:53.008720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:53.009151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:53.010473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:53.010926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:53.011346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:53.044258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:53.044901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:53.051461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:53.051991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:53.052439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:53.053142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:53.053592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:53.054013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:53.073578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:53.081694 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-745050f7-6c64-4d6b-b069-08af7b0f2699 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084369 Aug 22 19:48:53.082248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1513/2872] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:53.187274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:53.195409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-89abd004-7e5e-49d8-8262-f7e75a2ca9c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155139 Aug 22 19:48:53.196008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1360/2873] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:48:54.102490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:54.103089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:54.110096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:54.110583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:54.111042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:54.111764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:54.112217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:54.112646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:54.173145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:54.181331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a3b69c72-f7ac-412c-824e-3344be6e8de2 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082684 Aug 22 19:48:54.181892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1514/2874] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:54.216870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:54.217485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:54.223956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:54.224437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:54.224870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:54.225554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:54.226002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:54.226425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:54.359002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:54.367097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c8ae10a-e259-4063-a0c3-3c96ffb0b372 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154083 Aug 22 19:48:54.367679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1361/2875] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:55.201401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:55.202015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:55.208473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:55.208955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:55.209391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:55.210076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:55.210791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:55.211218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:55.271255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:55.279883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3a0f12d6-dfb7-45cc-b332-3bf0e476f315 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082301 Aug 22 19:48:55.280448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1515/2876] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:55 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:55.388410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:55.389023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:55.395405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:55.395972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:55.396361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:55.397049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:55.397502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:55.397932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:55.524931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:55.533133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e3acc9f-140d-4366-aa76-a063a2c9c2e7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149102 Aug 22 19:48:55.533701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1362/2877] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:56.300737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:56.301350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:56.308195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:56.308689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:56.309131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:56.309842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:56.310296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:56.310727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:56.374973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:56.383262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ec286a3f-fd70-4719-bfc5-c4e08431c900 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086434 Aug 22 19:48:56.383866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1516/2878] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:56 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:56.554294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:56.554896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:56.561813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:56.562288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:56.562725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:56.563445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:56.563930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:56.564357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:56.695341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:56.704416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe1bc0b0-32d3-41d8-92e3-f940d635dedb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153926 Aug 22 19:48:56.704913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1363/2879] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:57.404256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:57.404823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:57.411267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:57.411798 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:57.412242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:57.412939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:57.413399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:57.413830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:57.476811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:57.485534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ef9041c1-c4fe-451c-a9c0-2101e1442902 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085920 Aug 22 19:48:57.486099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1517/2880] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:57 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:57.725249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:57.725834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:57.732165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:57.732662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:57.733095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:57.733913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:57.734219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:57.734644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:57.861973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:57.869956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38f1ff68-d182-487a-a08c-9f58193d0d35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148549 Aug 22 19:48:57.870516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1364/2881] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:58.506389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:58.507005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:58.513378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:58.513884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:58.514320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:58.515006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:58.515459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:58.515910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:58.575455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:58.583564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-43b57df9-5e7e-462a-be35-58e66a5ba255 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081012 Aug 22 19:48:58.584146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1518/2882] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:58 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:58.891272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:58.891874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:58.897911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:58.898391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:58.898827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:58.899515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:58.899999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:58.900425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:59.031592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:59.039742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f175f51-459f-4a8e-8258-ecc1720ce5dd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152391 Aug 22 19:48:59.040304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1365/2883] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:48:59.604908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:48:59.605513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:48:59.612007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:59.612485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:59.612918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:59.613606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:48:59.614051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:48:59.614473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:48:59.674171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:48:59.682144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-aba54958-32bd-4500-bd83-05bbce5edf69 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081660 Aug 22 19:48:59.682749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1519/2884] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:48:59 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:00.059533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:00.060166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:00.066535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:00.067019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:00.067449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:00.068162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:00.068610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:00.069028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:00.085209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:00.198910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:00.207493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dde373af-c1d4-4bf4-94b7-5c1a87d05410 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151716 Aug 22 19:49:00.208186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1366/2885] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:00.702439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:00.703047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:00.709439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:00.709922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:00.710360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:00.711311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:00.711791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:00.712217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:00.774992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:00.783123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eaa261fa-0a09-4683-a1dd-52c73d98dff5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084605 Aug 22 19:49:00.783698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1520/2886] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:00 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:01.230800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:01.231418 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:01.237808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:01.238287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:01.238720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:01.239410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:01.239893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:01.240318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:01.366559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:01.374544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a33666bf-d211-4424-ae91-30414f5fb6fc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148263 Aug 22 19:49:01.375103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1367/2887] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:01.804357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:01.804977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:01.811457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:01.812004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:01.812440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:01.813124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:01.813570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:01.813990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:01.876036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:01.884066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5c977e98-11ca-4240-a981-04bf35bec161 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083701 Aug 22 19:49:01.884629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1521/2888] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:01 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:02.395814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:02.396467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:02.402988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:02.403465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:02.403937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:02.404689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:02.405139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:02.405556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:02.538740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:02.547478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5eb5939c-5a7f-4dd4-bafb-ac545da886af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155844 Aug 22 19:49:02.548069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1368/2889] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:02.905855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:02.906464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:02.913085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:02.913571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:02.914011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:02.914698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:02.915153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:02.915583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:02.976007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:02.984035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-052a9753-d4f5-4d57-a25e-45ac1cf1d501 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082740 Aug 22 19:49:02.984597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1522/2890] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:02 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:03.568733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:03.569327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:03.576424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:03.576914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:03.577352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:03.578039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:03.578485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:03.578909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:03.705178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:03.713613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4cc27eac-f967-42d6-8b64-e2272785bc96 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148711 Aug 22 19:49:03.714181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1369/2891] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:04.004497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:04.005103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:04.012334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:04.012829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:04.013269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:04.013967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:04.014463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:04.014889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:04.076407 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:04.084503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f5616cfe-ab2d-49b4-9d8d-ffeffe078811 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083836 Aug 22 19:49:04.085070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1523/2892] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:03 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:04.734967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:04.735571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:04.742076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:04.742549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:04.742980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:04.743668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:04.744143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:04.744564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:04.875225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:04.883466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e2bcd1e-f450-44f1-a278-5f1dbc775d19 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153033 Aug 22 19:49:04.884312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1370/2893] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:05.106288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:05.106842 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:05.113469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:05.113953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:05.114385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:05.115075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:05.115527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:05.116916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:05.184264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:05.192456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-afef2425-dff8-4e0c-906b-a2e76d4ce5b3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.091194 Aug 22 19:49:05.193019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1524/2894] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:05 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:05.904571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:05.905180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:05.911572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:05.912076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:05.912507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:05.913186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:05.913632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:05.914054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:06.042294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:06.050416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f26aa582-fcd5-4b1f-b47f-f7cae4722adb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149666 Aug 22 19:49:06.050985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1371/2895] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:06.212737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:06.213360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:06.216308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=58 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:06.221686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:06.222171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:06.222783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:06.223538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:06.224019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:06.224452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:06.238981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:06.285152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:06.293303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f7a27423-501c-4724-9be1-0fc5504d51dd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084644 Aug 22 19:49:06.293891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1525/2896] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:06 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:07.070508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:07.071364 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:07.077949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:07.078437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:07.078874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:07.079571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:07.080059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:07.080602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:07.212186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:07.220963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7db83ea2-41a4-4011-b6ec-ff9f2fa0b313 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154501 Aug 22 19:49:07.221522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1372/2897] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:07.313610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:07.314227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:07.320702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:07.321135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:07.321578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:07.322276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:07.322731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:07.323163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:07.385640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:07.395360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-05296e38-86d5-4db3-a6b2-0f57daa8b06a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085544 Aug 22 19:49:07.395966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1526/2898] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:07 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:08.242773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:08.243381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:08.250459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:08.250941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:08.251378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:08.252089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:08.252540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:08.252963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:08.382787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:08.390865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01caf8ec-1570-416e-a8f6-94610b25d9e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151997 Aug 22 19:49:08.391427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1373/2899] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:08.416252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:08.416781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:08.423650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:08.424211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:08.424706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:08.425441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:08.425891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:08.426311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:08.486637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:08.494698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ceec0952-b934-402d-a827-9aed08f45c54 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082263 Aug 22 19:49:08.495263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1527/2900] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:08 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:09.412134 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:09.412694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:09.419380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:09.419888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:09.420323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:09.421005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:09.421452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:09.421869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:09.515565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:09.516363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:09.522802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:09.523394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:09.523931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:09.524708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:09.525172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:09.525606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:09.549066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:09.557339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-63e10c7a-b9bf-4478-ac74-0bc0f779c39b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149342 Aug 22 19:49:09.557918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1374/2901] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:09 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:09.590150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:09.598349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-749f680b-60e2-46f6-a406-0f76bae756d0 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087237 Aug 22 19:49:09.598913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1528/2902] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:09 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:10.579034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:10.579694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:10.586315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:10.586786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:10.587221 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:10.587936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:10.588384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:10.588951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:10.619290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:10.620071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:10.626661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:10.627146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:10.627585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:10.628309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:10.628766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:10.629194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:10.691480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:10.699934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1f3ac2a5-5574-43ed-b453-9e2d243e5eba tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084349 Aug 22 19:49:10.701103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1529/2903] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:10.729869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:10.738131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b7120435-fb04-49dc-ab46-2e1f1d7687ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.163455 Aug 22 19:49:10.738694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1375/2904] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:11.721670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:11.722271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:11.728738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:11.729222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:11.729653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:11.730333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:11.730782 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:11.731203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:11.759447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:11.760062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:11.767119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:11.767598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:11.768068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:11.768756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:11.769199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:11.769617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:11.794661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:11.802799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a50528d3-5cfc-4522-93db-9faaf51ba1f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085119 Aug 22 19:49:11.803366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1530/2905] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:11 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:11.897202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:11.905436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a9385164-9a50-4b74-a89e-a7e63472235d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149664 Aug 22 19:49:11.905977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1376/2906] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:12.823580 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:12.824292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:12.831231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:12.831750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:12.832188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:12.832875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:12.833328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:12.833755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:12.893588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:12.901595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-089cff2c-235e-44a7-a47f-1f1350418b48 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081856 Aug 22 19:49:12.902154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1531/2907] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:12 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:12.926806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:12.927605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:12.934051 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:12.935036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:12.935530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:12.936288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:12.936855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:12.937279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:13.067825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:13.076590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3aa02e83-e972-4b48-9b53-a1852cfae416 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153580 Aug 22 19:49:13.077093 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1377/2908] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:13.922750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:13.923352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:13.929901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:13.930375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:13.930802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:13.931477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:13.931953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:13.932375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:13.995321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:14.003885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-60c7590c-eae0-4897-bda9-d379007f073a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085496 Aug 22 19:49:14.004446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1532/2909] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:13 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:14.097786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:14.098393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:14.105031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:14.105507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:14.105934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:14.106615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:14.107091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:14.107504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:14.233542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:14.241814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b17986d-f809-46b9-9c81-150325486e6b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147826 Aug 22 19:49:14.242383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1378/2910] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:15.024414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:15.025032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:15.032221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:15.032702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:15.033136 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:15.033819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:15.034424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:15.034891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:15.095493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:15.103515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1889a52f-d4aa-409b-946f-2030e22f627b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083024 Aug 22 19:49:15.104102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1533/2911] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:15 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:15.263179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:15.263819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:15.270326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:15.270804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:15.271240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:15.271953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:15.272407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:15.272829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:15.398428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:15.407033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1572e155-8df3-45dc-99d3-9cb9279f339a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148322 Aug 22 19:49:15.407592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1379/2912] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:15 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:16.124182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:16.124890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:16.131197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:16.131697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:16.132131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:16.132810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:16.133252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:16.133670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:16.193623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:16.201720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-55f1a8d3-5686-4ec0-86d7-5ad9ffcc4d0a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081383 Aug 22 19:49:16.202276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1534/2913] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:16 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:16.427205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:16.427921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:16.434219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:16.434703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:16.435840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:16.436536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:16.436988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:16.437414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:16.566107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:16.574196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-610f9589-bdf0-4106-96a2-3100b04cb893 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150817 Aug 22 19:49:16.574756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1380/2914] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:17.223005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:17.223610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:17.230150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:17.230639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:17.231078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:17.231804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:17.232263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:17.232690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:17.293224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:17.301241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ebeaae82-558c-4909-bf66-4c5d99b803f1 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082116 Aug 22 19:49:17.301801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1535/2915] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:17 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:17.595691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:17.596296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:17.602802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:17.603273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:17.603732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:17.604412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:17.604858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:17.605275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:17.736549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:17.744619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3ad0f929-5642-4b6b-80e0-493f7e4f31c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152834 Aug 22 19:49:17.745181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1381/2916] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:18.321818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:18.322423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:18.328921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:18.329397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:18.329827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:18.330510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:18.330953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:18.331369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:18.393769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:18.401805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f5dc07e0-6a41-4560-b0d4-e4fb6d06c6f3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083807 Aug 22 19:49:18.402362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1536/2917] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:18 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:18.766205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:18.766882 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:18.773131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:18.773604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:18.774036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:18.774723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:18.775164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:18.775586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:18.904861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:18.913652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51bdb27b-439c-45a6-a57c-fec50eb9561d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151340 Aug 22 19:49:18.914233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1382/2918] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:19.422495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:19.423071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:19.429582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:19.430067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:19.430505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:19.431200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:19.431668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:19.432096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:19.493650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:19.502537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bb8c0dcb-4acc-4094-82fe-2d0f0758744e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084078 Aug 22 19:49:19.503103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1537/2919] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:19 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:19.934192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:19.934800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:19.941832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:19.942307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:19.942738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:19.943416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:19.943898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:19.944319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:19.946801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:20.074776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:20.082900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e096868e-f6d4-4f2e-9406-62095b471add tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152516 Aug 22 19:49:20.083466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1383/2920] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:20.524309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:20.524899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:20.531910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:20.532399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:20.532831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:20.533514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:20.533960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:20.534382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:20.594336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:20.602390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6d7e3a9d-1b03-48c4-a345-8122aeabe1bd tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081924 Aug 22 19:49:20.602952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1538/2921] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:20 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:21.104645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:21.105238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:21.107506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=52 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:21.113244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:21.113729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:21.114192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:21.115010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:21.115462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:21.115916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:21.242993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:21.251706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b42c27a7-ff5a-4da4-b8fd-4eb1655f42cd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150864 Aug 22 19:49:21.252271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1384/2922] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:21.622702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:21.623301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:21.630954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:21.631429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:21.631892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:21.632577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:21.633023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:21.633442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:21.694278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:21.702494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-53d123a9-9621-49f6-b8b5-4b63f2bbe27b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083623 Aug 22 19:49:21.703060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1539/2923] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:21 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:22.273425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:22.274045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:22.280492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:22.280975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:22.281415 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:22.282114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:22.282567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:22.283022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:22.413877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:22.422010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d931e497-cbff-4da3-886d-8c09b1a5597e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152355 Aug 22 19:49:22.422570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1385/2924] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:22.722651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:22.723253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:22.730948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:22.731526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:22.731986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:22.732708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:22.733181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:22.733605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:22.799267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:22.807563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9b323430-0169-4d21-aebb-03f8fa3db424 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088823 Aug 22 19:49:22.808152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1540/2925] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:22 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:23.442279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:23.442890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:23.449301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:23.449772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:23.450233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:23.450911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:23.451357 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:23.451863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:23.584759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:23.593258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53b69c91-13fc-4899-8202-8799fadceaed tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154886 Aug 22 19:49:23.594473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1386/2926] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:23.829561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:23.830192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:23.836866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:23.837344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:23.837768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:23.838442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:23.838885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:23.839299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:23.899271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:23.907391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-58f51bca-da15-49e0-85ed-fb42d03e9670 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082318 Aug 22 19:49:23.907979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1541/2927] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:23 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:24.614586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:24.615183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:24.621531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:24.622004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:24.622433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:24.623114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:24.623558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:24.624012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:24.755306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:24.763445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-03eaaf58-dc2f-4329-b11a-dea9fbe55509 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152647 Aug 22 19:49:24.764039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1387/2928] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:24.929327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:24.930433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:24.942187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:24.942756 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:24.943468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:24.944197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:24.944647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:24.945064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:24.947605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:25.006148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:25.014105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0d03f39b-5d44-4a94-835d-8eb4309e1835 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.089315 Aug 22 19:49:25.014668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1542/2929] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:24 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:25.786621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:25.787250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:25.793877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:25.794363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:25.794803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:25.795496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:25.796081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:25.796509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:25.930997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:25.939056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6777f49b-3717-49da-8b5a-6a998f8c3a35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158164 Aug 22 19:49:25.939613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1388/2930] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:26.034592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:26.035204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:26.042013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:26.042445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:26.042887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:26.043613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:26.044094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:26.044518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:26.107227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:26.115382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b32077a1-384f-4cb7-9798-2563fae9f821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084589 Aug 22 19:49:26.115982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1543/2931] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:26 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:26.960893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:26.961534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:26.968103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:26.968588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:26.969024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:26.969711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:26.970161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:26.970587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:27.099447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:27.107551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d4a4dcc7-21c2-488b-a9d0-06450b3f512b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150813 Aug 22 19:49:27.108146 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1389/2932] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:27.136498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:27.137103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:27.144149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:27.144627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:27.145055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:27.145738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:27.146182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:27.147101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:27.213589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:27.223468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c79a648c-cac6-4576-8138-70c838901997 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.090834 Aug 22 19:49:27.224053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1544/2933] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:27 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:28.129212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:28.129819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:28.135786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:28.136259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:28.136685 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:28.137363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:28.137808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:28.138225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:28.244264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:28.244869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:28.251162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:28.251656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:28.252308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:28.252801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:28.253244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:28.253663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:28.265747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:28.273860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9984c0d4-d7c1-411f-89bd-b0dd98d83e72 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149292 Aug 22 19:49:28.274426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1390/2934] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:28.524718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:28.533367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-41af67c3-25ca-4225-a4e9-a7d4fd0158a6 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.293002 Aug 22 19:49:28.533924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1545/2935] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:28 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:29.294567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:29.295195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:29.301657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:29.302473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:29.302644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:29.303260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:29.303738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:29.304166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:29.435109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:29.444127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e42057d8-55e4-4150-b1cc-46de0bbba719 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153452 Aug 22 19:49:29.444725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1391/2936] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:29 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:29.554335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:29.554951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:29.561351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:29.561835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:29.562278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:29.562976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:29.563430 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:29.564538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:29.623614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:29.632377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-66d06be9-243a-4450-a67e-f21b6844de42 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081847 Aug 22 19:49:29.632948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1546/2937] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:29 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:30.465553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:30.466157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:30.472607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:30.473112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:30.473545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:30.474225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:30.474671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:30.475089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:30.604972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:30.613165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07e49ddf-3599-4fb7-a303-522b7f5517c2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151407 Aug 22 19:49:30.613740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1392/2938] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:30.652700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:30.653342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:30.659809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:30.660288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:30.660904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:30.661587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:30.662068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:30.662494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:30.722134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:30.730298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-abcbca0c-48ff-4147-878e-632de56ed5b7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081430 Aug 22 19:49:30.730858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1547/2939] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:30 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:31.636318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:31.636922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:31.643858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:31.644349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:31.644794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:31.645486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:31.645947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:31.646374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:31.751712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:31.752313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:31.758382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:31.758866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:31.759309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:31.760028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:31.760481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:31.760904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:31.773935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:31.782104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ea1b22d-2cbe-4604-b095-2e30e441dd86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149661 Aug 22 19:49:31.782676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1393/2940] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:31.820789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:31.829049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-50d8b321-ec16-4972-8859-c979f7317d5f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081257 Aug 22 19:49:31.829627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1548/2941] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:31 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:32.804271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:32.804885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:32.811233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:32.811740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:32.812177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:32.812862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:32.813312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:32.813738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:32.850793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:32.851483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:32.858066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:32.858620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:32.859117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:32.859899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:32.860415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:32.860902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:32.924848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:32.932917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4cbe2ce7-b037-4d37-afc1-715ebf9a94ec tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086421 Aug 22 19:49:32.933480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1549/2942] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:32 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:32.949952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:32.958691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-516013a1-27f5-4458-9736-1ce35eb65156 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158818 Aug 22 19:49:32.959258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1394/2943] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:33.953902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:33.954512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:33.961788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:33.962247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:33.962679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:33.963359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:33.963846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:33.964267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:33.979953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:33.980563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:33.986897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:33.987753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:33.988282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:33.988974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:33.989420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:33.989835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:34.026942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:34.037956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7c2c13d1-da57-44ae-96a8-2d4a55315bcc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.087876 Aug 22 19:49:34.038858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1550/2944] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:33 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:34.124661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:34.132934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d14febc2-27f5-475a-b764-95d63a86bca4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.156789 Aug 22 19:49:34.133513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1395/2945] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:35.058509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:35.059129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:35.066166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:35.066634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:35.067088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:35.067793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:35.068239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:35.068815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:35.130243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:35.138567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-261823f9-f826-4196-a03e-942ac5c935b9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083916 Aug 22 19:49:35.139139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1551/2946] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:35 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:35.154341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:35.155065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:35.161528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:35.162017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:35.162457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:35.163187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:35.163653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:35.164089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:35.294030 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:35.302742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7031daa-59be-4e7b-bb93-e7d647323eca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152324 Aug 22 19:49:35.303308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1396/2947] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:36.160339 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:36.160921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:36.167385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:36.167889 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:36.168324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:36.169005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:36.169451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:36.169866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:36.230250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:36.238341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b59c70ff-4723-4bfa-9ff9-2a01fcb24b5b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082475 Aug 22 19:49:36.238901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1552/2948] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:36 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:36.323897 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:36.324550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:36.330765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:36.331784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:36.332226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:36.332912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:36.333366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:36.333792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:36.464117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:36.472277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-470586b9-0a77-4c9b-b9b5-411a9beaa7ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152594 Aug 22 19:49:36.472847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1397/2949] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:37.258402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:37.259111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:37.261744 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=56 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:37.267133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:37.267662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:37.268089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:37.268773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:37.269220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:37.269641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:37.332455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:37.340829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b735356e-30a4-4f4e-b8b1-c92b779b4e94 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086261 Aug 22 19:49:37.341595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1553/2950] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:37 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:37.493385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:37.493999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:37.500448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:37.500924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:37.501356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:37.502035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:37.502483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:37.502907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:37.628583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:37.636859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a27072d-7264-4f94-aeb7-d2249814739e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147316 Aug 22 19:49:37.637426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1398/2951] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:38.365057 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:38.365816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:38.374148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:38.374944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:38.375542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:38.376266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:38.376718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:38.377144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:38.437113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:38.445626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4e2e2bdd-33b4-42b5-9ac1-661c33c40fc7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084943 Aug 22 19:49:38.446181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1554/2952] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:38 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:38.658212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:38.658812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:38.665926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:38.666417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:38.666856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:38.667548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:38.668029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:38.668453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:38.807268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:38.809471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:38.816681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0168585f-47cb-41e9-98ce-02229326958b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.162373 Aug 22 19:49:38.817243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1399/2953] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:39.466460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:39.467108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:39.473586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:39.474096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:39.474535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:39.475217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:39.475690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:39.476224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:39.536150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:39.544361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4657e057-86c5-42b7-abd2-380bd91784d5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081743 Aug 22 19:49:39.544927 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1555/2954] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:39 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:39.837918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:39.838485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:39.845152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:39.845631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:39.846064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:39.846744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:39.847191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:39.847688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:39.976924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:39.985001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-260400a8-91e9-4ee6-bacc-b970d5dba111 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151241 Aug 22 19:49:39.985558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1400/2955] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:40.565133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:40.565743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:40.572589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:40.573069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:40.573501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:40.574185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:40.574635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:40.575058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:40.636353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:40.645101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-45ee321a-3ab6-472a-897f-88e43afcee92 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083326 Aug 22 19:49:40.645672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1556/2956] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:40 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:41.007166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:41.007783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:41.014129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:41.014604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:41.015038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:41.015749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:41.016196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:41.016615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:41.148652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:41.157366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9073bb78-7151-48fb-8932-300fc9ee575f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154545 Aug 22 19:49:41.157926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1401/2957] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:41.666286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:41.666894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:41.673403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:41.673882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:41.674315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:41.675002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:41.675448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:41.676544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:41.740308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:41.748365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-be77dfdb-d8d4-4a4f-bc9e-c40758abb163 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086037 Aug 22 19:49:41.748923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1557/2958] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:41 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:42.178363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:42.178979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:42.185400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:42.185880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:42.186311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:42.186995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:42.187444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:42.187895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:42.314447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:42.322570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f2223f7-11bd-4ded-9516-765b0c69eed9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148157 Aug 22 19:49:42.323136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1402/2959] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:42.769346 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:42.769951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:42.776458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:42.776939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:42.777375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:42.778092 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:42.778548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:42.778972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:42.839914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:42.842072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:42.849817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8f6216f5-e1a0-45a5-b20c-b7640ef49cc4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084609 Aug 22 19:49:42.850395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1558/2960] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:42 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:43.343979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:43.344595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:43.350990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:43.351502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:43.351972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:43.352664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:43.353116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:43.353541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:43.481142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:43.489434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e92fb7b6-ea83-42d4-8105-df1969dacb44 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149359 Aug 22 19:49:43.490011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1403/2961] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:43 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:43.870171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:43.870800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:43.877261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:43.877745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:43.878182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:43.879620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:43.880110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:43.880542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:43.942710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:43.950732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7d56d81e-eaf4-4217-b982-7c29f0abeef5 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084376 Aug 22 19:49:43.951315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1559/2962] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:43 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:44.510508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:44.511159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:44.517532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:44.518003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:44.518431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:44.519106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:44.520148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:44.520570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:44.652903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:44.662799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e98758e-8033-457c-9f02-51d5dfdea272 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.156078 Aug 22 19:49:44.663345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1404/2963] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:44.972219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:44.972864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:44.979466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:44.979981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:44.980421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:44.981114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:44.981567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:44.981991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:45.043096 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:45.051715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b4b40092-378b-463a-9834-463a6d340158 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083259 Aug 22 19:49:45.052277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1560/2964] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:44 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:45.683668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:45.684312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:45.690644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:45.691631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:45.692099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:45.692840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:45.693290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:45.693716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:45.820488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:45.828512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-963eac29-ae46-40ba-8198-98dcacd52ed3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148737 Aug 22 19:49:45.829087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1405/2965] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:46.072966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:46.073510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:46.080081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:46.080553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:46.081017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:46.081699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:46.082178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:46.082601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:46.153811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:46.162557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bf64cc1b-534a-4d6f-a397-fab3d253781a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.093483 Aug 22 19:49:46.163118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1561/2966] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:46 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:46.850537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:46.851148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:46.857687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:46.858169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:46.858603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:46.859293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:46.859773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:46.860204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:46.990229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:46.998994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e5fc1af4-bcc5-4a88-8c62-59dfed8e0acd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152948 Aug 22 19:49:46.999599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1406/2967] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:47.182252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:47.182860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:47.189275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:47.189748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:47.190203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:47.190879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:47.191326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:47.192326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:47.253467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:47.262569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-10a6f4d7-fa00-42b1-a16d-0829679e606d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084118 Aug 22 19:49:47.263190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1562/2968] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:47 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:48.023302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:48.023988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:48.030394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:48.030879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:48.031309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:48.032012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:48.032462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:48.032884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:48.162989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:48.171199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2bbf45ff-aa9e-4aa6-8f3d-d2ed4a6607ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152284 Aug 22 19:49:48.171797 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1407/2969] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:48.284041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:48.284653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:48.291633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:48.292140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:48.292573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:48.293263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:48.293711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:48.294134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:48.356069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:48.364078 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fd2e9de1-9f98-456d-b9ad-b785fe68b03f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083780 Aug 22 19:49:48.364641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1563/2970] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:48 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:49.192743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:49.193349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:49.199764 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:49.200247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:49.200682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:49.201371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:49.201819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:49.202240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:49.330177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:49.339355 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22cc9b74-92d8-4c82-9671-cab679dde14a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150988 Aug 22 19:49:49.339953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1408/2971] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:49.385369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:49.385979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:49.392384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:49.392864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:49.393299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:49.393983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:49.394439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:49.395430 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:49.454095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:49.463294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bdf82d51-0a94-4e4e-97b3-a11452d38550 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082011 Aug 22 19:49:49.463901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1564/2972] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:49 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:50.362070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:50.362750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:50.369676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:50.370158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:50.370595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:50.371284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:50.371759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:50.372183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:50.483707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:50.484312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:50.491188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:50.491716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:50.492154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:50.492871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:50.493317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:50.493733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:50.506496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:50.515067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6d42f0f-6107-4f3b-8f94-59bad775792b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.156804 Aug 22 19:49:50.515622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1409/2973] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:50.557783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:50.565880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1ac2a63f-9951-4819-93f7-9aabcca9256d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086034 Aug 22 19:49:50.566439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1565/2974] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:50 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:51.536655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:51.537263 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:51.539518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=52 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:51.544818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:51.545298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:51.545730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:51.546420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:51.546862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:51.547283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:51.587617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:51.588277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:51.594607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:51.595087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:51.595518 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:51.596232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:51.596682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:51.597098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:51.657913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:51.665930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-73a47fec-4529-4a36-bd3c-3fea035fb399 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082274 Aug 22 19:49:51.666501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1566/2975] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:51 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:49:51.676758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:51.684918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0f94da2-7213-4a63-b476-7421631b51e6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152302 Aug 22 19:49:51.685480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1410/2976] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:52.686382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:52.687021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:52.693539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:52.694025 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:52.694463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:52.695164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:52.695618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:52.696084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:52.697163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d8323c2-2cd3-4e21-b998-d0480f90c903 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:52.697655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d8323c2-2cd3-4e21-b998-d0480f90c903 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:52.704164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8323c2-2cd3-4e21-b998-d0480f90c903 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:52.704639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8323c2-2cd3-4e21-b998-d0480f90c903 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:52.705071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8323c2-2cd3-4e21-b998-d0480f90c903 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:52.705755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8323c2-2cd3-4e21-b998-d0480f90c903 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:52.706203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8323c2-2cd3-4e21-b998-d0480f90c903 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:52.706620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8323c2-2cd3-4e21-b998-d0480f90c903 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:52.730652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d8323c2-2cd3-4e21-b998-d0480f90c903 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41/ips" status: 200 len: 149 microversion: 2.1 time: 0.037309 Aug 22 19:49:52.731229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1411/2977] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:49:52 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:49:52.735593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:52.736269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:52.742264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:52.742507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:52.742938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:52.743630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:52.744104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:52.744525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:52.758769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:52.766931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1cf24f41-3d8a-4a15-81cb-992bfd9d2d26 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.084354 Aug 22 19:49:52.767496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1567/2978] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:52 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:52.883565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:52.891927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6df4e443-5e86-4da3-8620-a5bbd7f7e186 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.159725 Aug 22 19:49:52.892593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1412/2979] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:53.789787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:53.790360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:53.796733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:53.797218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:53.797649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:53.798334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:53.798783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:53.799205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:53.859364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:53.868073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-659f5c66-02de-4cde-9f84-df7fcf5f6b12 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082751 Aug 22 19:49:53.868641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1568/2980] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:53 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:53.912870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:53.913477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:53.919912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:53.920389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:53.920818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:53.921577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:53.921926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:53.922341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:54.056190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:54.064439 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1bca934c-ee4b-4029-9101-149e674863c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155580 Aug 22 19:49:54.064992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1413/2981] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:54.888965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:54.889578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:54.896431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:54.896939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:54.897372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:54.898054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:54.898503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:54.898925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:54.962053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:54.970343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-54e95ef5-240d-4f7d-becc-6561b1f4e260 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085316 Aug 22 19:49:54.970904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1569/2982] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:54 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:55.085787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:55.086530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:55.093256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:55.093738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:55.094177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:55.094871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:55.095325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:55.095804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:55.226297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:55.234336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0edbf1f-3dc8-4a74-92ea-28ad1e299aab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153064 Aug 22 19:49:55.234896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1414/2983] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:55.991450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:55.992088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:55.998572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:55.999054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:55.999489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:56.000199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:56.000655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:56.001080 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:56.062377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:56.071235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a02fad0a-262c-426f-b380-a6e09fd868cc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.083659 Aug 22 19:49:56.071746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1570/2984] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:55 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:56.255016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:56.256250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:56.262694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:56.263170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:56.263601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:56.264312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:56.264757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:56.265175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:56.394083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:56.402921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a387f6af-c372-4a40-9173-35567eae2700 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151717 Aug 22 19:49:56.403485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1415/2985] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:57.092396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:57.093017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:57.100000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:57.100481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:57.100917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:57.101596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:57.102043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:57.102465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:57.167915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:57.177903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-037819fb-854d-47f1-8410-030a88460efc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.089396 Aug 22 19:49:57.178477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1571/2986] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:57 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:57.424393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:57.424999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:57.432011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:57.432497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:57.432935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:57.433622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:57.434075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:57.434500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:57.561514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:57.563672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:49:57.570904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47761d4d-50fa-464c-b189-5ebd4239adbf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150462 Aug 22 19:49:57.571465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1416/2987] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:58.200825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:58.201484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:58.208125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:58.209175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:58.209609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:58.210290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:58.210986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:58.211404 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:58.275386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:58.283569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4d486d26-aefa-4218-b494-1c0778f44043 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086717 Aug 22 19:49:58.284180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1572/2988] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:58 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:58.592378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:58.592930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:58.599589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:58.600111 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:58.600550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:58.601247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:58.601701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:58.602142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:58.731977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:58.740483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a15c3ee-fa98-44a9-bf84-cf6cea4d93eb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152343 Aug 22 19:49:58.741056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1417/2989] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:59.304849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:59.305440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:59.311917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:59.312390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:59.312817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:59.313492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:59.313938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:59.314355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:59.378041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:59.386647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8ef1171f-a524-44ca-afa4-c6df22f3901c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086201 Aug 22 19:49:59.387228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1573/2990] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:59 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:49:59.762097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:49:59.762730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:49:59.769163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:59.769645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:59.770082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:59.771434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:49:59.771918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:49:59.772346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:49:59.913298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:49:59.921448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58023c92-beb3-4f76-bfb1-6bc1859bedd7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.163164 Aug 22 19:49:59.922191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1418/2991] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:49:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:00.408108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:00.408652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:00.415510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:00.416015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:00.416446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:00.417122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:00.417567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:00.417983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:00.478412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:00.486640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b47ae815-f15f-4504-a6c6-a0f4fb2a5ac9 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082532 Aug 22 19:50:00.487244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1574/2992] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:00 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:00.942508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:00.943125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:00.949603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:00.950086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:00.950521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:00.951306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:00.951792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:00.952224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:01.092655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:01.101275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7026b606-8ca3-4af1-bbda-86cc2c042767 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.162609 Aug 22 19:50:01.101867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1419/2993] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:01.508299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:01.508944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:01.515044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:01.515524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:01.515992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:01.516683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:01.517137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:01.517563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:01.531916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:01.577789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:01.586089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f02051e9-6182-463d-bb44-cbc069b1d2ae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082372 Aug 22 19:50:01.586657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1575/2994] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:01 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:02.122228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:02.122931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:02.129539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:02.130530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:02.130963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:02.131699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:02.132151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:02.132600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:02.259612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:02.267814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aee00f7a-b824-46aa-91fd-10e4d7568e9f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149436 Aug 22 19:50:02.268382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1420/2995] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:02.606653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:02.607217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:02.613573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:02.614053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:02.614486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:02.615170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:02.615621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:02.616073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:02.675918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:02.684052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9b0a5e28-5fe2-4220-b5b3-f19a256bb391 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081252 Aug 22 19:50:02.684612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1576/2996] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:02 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:03.289130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:03.289741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:03.296169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:03.296652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:03.297085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:03.297771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:03.298223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:03.298649 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:03.423487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:03.431576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ab32870-c065-4326-80cc-3ed2f8af6871 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.146893 Aug 22 19:50:03.432166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1421/2997] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:03.704809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:03.705405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:03.712600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:03.713073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:03.713503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:03.714183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:03.714627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:03.715043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:03.779370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:03.789293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ce18c25b-328b-421d-a3a0-1a3dca8ba01e tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088334 Aug 22 19:50:03.789859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1577/2998] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:03 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:04.453083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:04.453716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:04.460231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:04.460979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:04.461416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:04.462107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:04.462561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:04.462984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:04.594847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:04.603741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae0d5425-1fc4-4fe8-b3e6-853af2978987 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154578 Aug 22 19:50:04.604342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1422/2999] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:04.810552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:04.811121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:04.817505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:04.817990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:04.818431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:04.819126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:04.819581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:04.820033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:04.881024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:04.889108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cc002dd6-eb9e-4e3d-bcb4-3b5215b9c648 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082484 Aug 22 19:50:04.889670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1578/3000] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:04 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:05.625315 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:05.625948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:05.633073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:05.633556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:05.633995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:05.634686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:05.635143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:05.635568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:05.764029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:05.772761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41ef7502-d7cf-453a-9ceb-929962efd591 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151421 Aug 22 19:50:05.773304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1423/3001] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:05.910145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:05.910716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:05.917046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:05.917529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:05.917958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:05.918637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:05.919083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:05.919501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:05.980918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:05.989072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1fb8ff2e-5435-4690-9ffa-fe1f0ad1e84b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.082824 Aug 22 19:50:05.990172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1579/3002] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:05 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:06.793601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:06.794230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:06.800618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:06.801104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:06.801539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:06.802741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:06.803215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:06.803637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:06.934100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:06.942199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-791b4957-3c95-49d1-9ab2-8533091ff67d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152498 Aug 22 19:50:06.943342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1424/3003] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:07.009967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:07.010577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:07.017115 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:07.017597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:07.018030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:07.018718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:07.019169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:07.019591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:07.084547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:07.093058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9e61586e-04bb-4f9f-82f5-44aef59806c4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086874 Aug 22 19:50:07.093625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1580/3004] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:07 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:07.963499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:07.964142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:07.970589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:07.971072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:07.971508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:07.972249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:07.972701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:07.973162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:08.102776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:08.111391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-984c6b41-cc46-4b4c-babf-391994b175af tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151948 Aug 22 19:50:08.120750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1425/3005] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:08.121047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:08.121047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:08.121047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=56 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:08.122135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:08.122713 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:08.123215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:08.124020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:08.124560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:08.125208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:08.188625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:08.197242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7c2e36c4-2cec-460f-a744-e9601df5d038 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.088267 Aug 22 19:50:08.197802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1581/3006] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:08 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:09.134489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:09.135059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:09.141456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:09.141947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:09.142408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:09.143080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:09.143532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:09.143983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:09.218344 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:09.218947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:09.225097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:09.225584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:09.226017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:09.226714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:09.227162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:09.227582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:09.275879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:09.284080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96ea7de7-f33a-402e-99fd-584d17eb2164 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154144 Aug 22 19:50:09.284658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1426/3007] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:09 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:09.287843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:09.296036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0c2dcd12-43d2-495b-a60f-1751b6368afe tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081552 Aug 22 19:50:09.296595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1582/3008] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:09 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:10.305346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:10.305942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:10.312380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:10.312857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:10.313286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:10.313975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:10.314421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:10.314838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:10.317186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:10.318311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:10.324773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:10.325260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:10.325702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:10.326402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:10.326854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:10.327282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:10.391263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:10.400022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-466cdfa4-15e6-4ca0-aa29-74a6a4f1507d tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.086835 Aug 22 19:50:10.400598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1583/3009] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:10 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:10.444489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:10.452995 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9b3d30de-01b1-40e8-9946-017a7be381e3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151486 Aug 22 19:50:10.453562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1427/3010] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:11.420666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:11.421233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:11.427743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:11.428220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:11.428650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:11.429326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:11.429770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:11.430188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:11.475761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:11.476393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:11.482745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:11.483226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:11.483672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:11.484376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:11.484821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:11.485245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:11.490142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:11.498443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d58f695e-9e51-408a-82d7-b8d01acf9175 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081695 Aug 22 19:50:11.499008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1584/3011] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:11 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:11.611028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:11.619186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de59769a-6510-43d3-bbd1-aee40bebf5a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147916 Aug 22 19:50:11.619798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1428/3012] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:12.518341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:12.518954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:12.526190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:12.526672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:12.527105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:12.527843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:12.528292 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:12.528711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:12.592073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:12.600132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-508247c3-206f-48a2-81ab-ca916920ae50 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.085667 Aug 22 19:50:12.600688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1585/3013] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:12 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:12.640398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:12.641013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:12.648058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:12.648541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:12.648979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:12.649667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:12.650119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:12.650540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:12.781643 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:12.789788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e3190bc-713d-4e90-b8f0-dc84ccd4a75e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153235 Aug 22 19:50:12.790348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1429/3014] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:13.620683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:13.621409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:13.627424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:13.627921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:13.628353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:13.629029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:13.629477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:13.630528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:13.689390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:13.698073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4aa8bd21-62c3-4d37-814d-d40bd997762c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081217 Aug 22 19:50:13.698630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1586/3015] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:13 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:13.811478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:13.812119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:13.819231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:13.819737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:13.820172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:13.820861 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:13.821323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:13.821741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:13.949697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:13.957930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b528b2de-3a44-438f-ae89-c25e40ee2cb5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150341 Aug 22 19:50:13.958493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1430/3016] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:14.718560 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:14.719158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:14.725646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:14.726123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:14.726556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:14.727236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:14.727707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:14.728132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:14.788326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:14.796345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-55fcdf3b-9d1d-46f0-87ac-cd0857da35bc tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 200 len: 1368 microversion: 2.1 time: 0.081645 Aug 22 19:50:14.796914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1587/3017] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:14 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:14.817024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-699e9791-a7f3-45dc-bb1b-2f56f4fcb211 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '.version_select at 0x7f66e40dc0d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:14.841003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-699e9791-a7f3-45dc-bb1b-2f56f4fcb211 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476774537" status: 202 len: 0 microversion: 2.1 time: 0.027576 Aug 22 19:50:14.841641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1431/3018] 10.222.0.61 () {58 vars in 1218 bytes} [Mon Aug 22 19:50:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476774537 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:50:14.978691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:14.979170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:14.985221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:14.985712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:14.986153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:14.986923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:14.987689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:14.987838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:15.215727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:15.224157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-86987aaa-bac9-4e8d-94af-8c70db35c0f0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.249327 Aug 22 19:50:15.224656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1588/3019] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:15.730855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5026f1a6-5a49-492b-8f53-3bccc460aac4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Action: 'create', calling method: .version_select at 0x7f66e40ab550>, body: {"keypair": {"name": "tempest-keypair-1832813430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtwfV5ORFaPFPPlJOo97oSBxKajDTQbN27dis0AfFtN8P35utJ29IfNJyOybYIXgqtnn/GiEXUda5r2Qbh4odeXlLmrmrmTXI+CquxlLsJGNP4DWhtzBV+dTO3eF69jHQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:50:15.747401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5026f1a6-5a49-492b-8f53-3bccc460aac4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Getting quotas for project ca75caa807b445f486899173277b5051. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:50:15.751630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5026f1a6-5a49-492b-8f53-3bccc460aac4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Getting quotas for user 21d0ab6d1a724547b8c643287df897da and project ca75caa807b445f486899173277b5051. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:50:15.773789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5026f1a6-5a49-492b-8f53-3bccc460aac4 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046944 Aug 22 19:50:15.774380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1432/3020] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 19:50:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:50:16.245146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:16.245871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:16.252539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:16.252936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:16.253371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:16.254071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:16.254524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:16.255462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:16.453884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:16.463610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-baf626f8-348c-406c-b2a7-b47f9beb23ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.222337 Aug 22 19:50:16.464210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1589/3021] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:17.089548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1474246326", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72f2b4fb-f148-44f1-907b-babe480eca91"}], "security_groups": [{"name": "tempest-securitygroup--1956191171"}], "key_name": "tempest-keypair-1832813430", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:50:17.201520 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] validate_networks() for [('72f2b4fb-f148-44f1-907b-babe480eca91', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:50:17.484325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:17.484926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:17.491376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:17.491898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:17.492335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:17.493026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:17.493474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:17.493897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:17.626190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:17.635345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-339b6284-d0eb-4d1a-951a-b55d357cc373 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154932 Aug 22 19:50:17.635595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:50:17.635951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1590/3022] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:17.636112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:50:17.636506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:50:17.637086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:50:17.637508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:50:17.647480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:17.647994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:17.648434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:17.649157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:17.649612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:17.650036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:17.666334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Getting quotas for project ca75caa807b445f486899173277b5051. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:50:17.670266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Getting quotas for user 21d0ab6d1a724547b8c643287df897da and project ca75caa807b445f486899173277b5051. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:50:17.681058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:50:17.683339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:50:17.735121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-825912b2-a229-4f7e-b7f1-8e579c4639c8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.650104 Aug 22 19:50:17.735791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1433/3023] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:50:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:50:17.746572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ddce7c2e-2fa9-48cf-89a5-eb94849b5b5a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:17.747180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ddce7c2e-2fa9-48cf-89a5-eb94849b5b5a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:17.800808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ddce7c2e-2fa9-48cf-89a5-eb94849b5b5a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:17.807556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ddce7c2e-2fa9-48cf-89a5-eb94849b5b5a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1238 microversion: 2.1 time: 0.064872 Aug 22 19:50:17.808150 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1591/3024] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:17 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:18.657272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:18.657883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:18.664781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:18.665267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:18.665704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:18.666404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:18.666855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:18.667277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:18.829293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:18.830762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:18.839187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:18.839699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:18.840389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:18.841097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:18.841546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:18.842140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:18.896486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:18.904669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d6f56ee-0988-462d-9c26-c652e43a2122 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.251744 Aug 22 19:50:18.905241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1434/3025] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:18.910566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:18.921873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8d3970e5-1b7b-487c-8413-af145b328093 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1296 microversion: 2.1 time: 0.096957 Aug 22 19:50:18.922536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1592/3026] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:18 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:19.927031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:19.928234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:19.934828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:19.935239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:19.937072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:19.937072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:19.937072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:19.937411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:19.942433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:19.943549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:19.953152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:19.955829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:19.956281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:19.956993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:19.957620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:19.957864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:19.963091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:20.096011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:20.103982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-649b095e-9f1e-4aeb-980f-3b094d78eee3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1364 microversion: 2.1 time: 0.165403 Aug 22 19:50:20.104568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1593/3027] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:19 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:20.416034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:20.424627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-afebbf85-7b80-45c3-9440-e90dc28dca4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.501478 Aug 22 19:50:20.425295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1435/3028] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:20.591014 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-80b1288d-11a2-461c-a11b-5f190838a3a4 req-34c7cf98-2eca-4373-9c0a-b538a2fca91b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112dfb61-c9eb-465e-88b2-80e8b69e1876", "tag": "cd7e324c-3e1f-4cca-a122-37aec45675a7"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:50:20.601663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-80b1288d-11a2-461c-a11b-5f190838a3a4 req-34c7cf98-2eca-4373-9c0a-b538a2fca91b service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:20.602166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-80b1288d-11a2-461c-a11b-5f190838a3a4 req-34c7cf98-2eca-4373-9c0a-b538a2fca91b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:20.602600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-80b1288d-11a2-461c-a11b-5f190838a3a4 req-34c7cf98-2eca-4373-9c0a-b538a2fca91b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:20.613590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-80b1288d-11a2-461c-a11b-5f190838a3a4 req-34c7cf98-2eca-4373-9c0a-b538a2fca91b service nova] Creating event network-changed:cd7e324c-3e1f-4cca-a122-37aec45675a7 for instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 on hv-cinder-83538 Aug 22 19:50:20.619392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-80b1288d-11a2-461c-a11b-5f190838a3a4 req-34c7cf98-2eca-4373-9c0a-b538a2fca91b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088497 Aug 22 19:50:20.620009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1594/3029] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:50:21.124471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:21.125034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:21.131991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:21.132472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:21.132904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:21.133591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:21.134043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:21.134502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:21.138361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:21.264564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:21.272137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-52f68d51-90a7-4781-af6e-7fbe850faa55 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1364 microversion: 2.1 time: 0.151587 Aug 22 19:50:21.272715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1436/3030] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:21 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:21.446503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:21.447347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:21.453538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:21.454020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:21.454456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:21.455144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:21.455596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:21.456046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:21.582279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:21.590685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0ae257e3-d4c8-4364-be7d-f0dd7b5615be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148921 Aug 22 19:50:21.591286 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1595/3031] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:22.293688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:22.294239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:22.296705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:22.302946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:22.303456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:22.303927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:22.304648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:22.305096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:22.305514 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:22.441202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:22.449250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ff35e72-d49a-4bec-9be7-da954b8a3613 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1364 microversion: 2.1 time: 0.160013 Aug 22 19:50:22.449809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1437/3032] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:22 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:22.612132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:22.612681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:22.619228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:22.619742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:22.620178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:22.620888 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:22.621336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:22.621755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:22.749882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:22.760255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ce328eeb-42b3-4f24-9e00-c2a0b5c5ce3b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152092 Aug 22 19:50:22.760825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1596/3033] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:23.470675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:23.471296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:23.478422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:23.478906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:23.479345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:23.480069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:23.480523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:23.480948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:23.782071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:23.782930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:23.789531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:23.790020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:23.790459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:23.791164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:23.791616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:23.792066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:23.854461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:23.862411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb18b499-1308-4a6f-b417-ebfc7c080349 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1364 microversion: 2.1 time: 0.395736 Aug 22 19:50:23.862989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1438/3034] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:23 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1364 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:23.922390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:23.931199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a1629c2b-c285-43fd-9ec4-b8f4d7a112f1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153232 Aug 22 19:50:23.931795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1597/3035] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:24.884054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:24.884666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:24.891034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:24.891521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:24.891991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:24.892678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:24.893128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:24.893551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:24.952005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:24.952611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:24.958932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:24.959414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:24.959891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:24.960845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:24.961307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:24.961727 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:25.027551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:25.035413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bbda8280-5f41-4352-8610-1faeed548561 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1364 microversion: 2.1 time: 0.155720 Aug 22 19:50:25.047731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1439/3036] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:24 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:25.093660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:25.102414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2c4cbe5c-6758-48ad-9dab-a2eba4f24194 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154339 Aug 22 19:50:25.102993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1598/3037] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:26.057349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:26.057942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:26.064384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:26.064883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:26.065316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:26.065993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:26.066438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:26.066858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:26.123289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:26.123937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:26.130047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:26.132623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:26.133100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:26.133809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:26.134262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:26.134682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:26.197046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:26.204883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-04b34de7-1d5f-4112-9810-c8651428ecbb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1364 microversion: 2.1 time: 0.151333 Aug 22 19:50:26.205450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1440/3038] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:26 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:26.268678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:26.276864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-94de4efe-4bee-4b4f-a190-61594dddfb60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.157318 Aug 22 19:50:26.277427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1599/3039] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:27.175202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-1835d8d8-d16c-4ad4-8b10-a50c262e262e req-7d9326e0-2a78-4eb7-8887-c3f8f7cfb881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112dfb61-c9eb-465e-88b2-80e8b69e1876", "name": "network-vif-plugged", "status": "completed", "tag": "cd7e324c-3e1f-4cca-a122-37aec45675a7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:50:27.188279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1835d8d8-d16c-4ad4-8b10-a50c262e262e req-7d9326e0-2a78-4eb7-8887-c3f8f7cfb881 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:27.188754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1835d8d8-d16c-4ad4-8b10-a50c262e262e req-7d9326e0-2a78-4eb7-8887-c3f8f7cfb881 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:27.189179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-1835d8d8-d16c-4ad4-8b10-a50c262e262e req-7d9326e0-2a78-4eb7-8887-c3f8f7cfb881 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:27.201145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-1835d8d8-d16c-4ad4-8b10-a50c262e262e req-7d9326e0-2a78-4eb7-8887-c3f8f7cfb881 service nova] Creating event network-vif-plugged:cd7e324c-3e1f-4cca-a122-37aec45675a7 for instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 on hv-cinder-83538 Aug 22 19:50:27.206225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-1835d8d8-d16c-4ad4-8b10-a50c262e262e req-7d9326e0-2a78-4eb7-8887-c3f8f7cfb881 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038861 Aug 22 19:50:27.206808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1441/3040] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:50:27.225151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:27.225758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:27.232030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:27.232507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:27.232938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:27.233624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:27.234076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:27.234497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:27.298720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:27.299700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:27.307234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:27.308022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:27.308811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:27.309564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:27.310254 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:27.310902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:27.372040 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:27.381802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8462d7df-1b50-461c-b3bd-ab0dd0501b0f tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1364 microversion: 2.1 time: 0.160395 Aug 22 19:50:27.382384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1600/3041] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:27 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:27.496680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:27.505410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c222b8c8-9862-4934-94f7-936da3c9bb59 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.211239 Aug 22 19:50:27.505985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1442/3042] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:27 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:28.402541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:28.403138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:28.405212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:28.411271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:28.412305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:28.412740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:28.413436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:28.413884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:28.414338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:28.526687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:28.527326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:28.529580 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:28.530389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:28.535986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:28.536473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:28.537551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:28.538305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:28.538758 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:28.539184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:28.546366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:28.553975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-50327104-a3c6-4285-931c-6f77e6224207 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1364 microversion: 2.1 time: 0.155334 Aug 22 19:50:28.554547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1601/3043] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:28 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:28.668027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:28.676265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-218933a0-1108-4be0-94f6-d4dcbc0ac18b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153395 Aug 22 19:50:28.676827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1443/3044] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:29.574932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:29.575556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:29.581923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:29.582405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:29.582837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:29.583525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:29.584003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:29.584429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:29.698006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:29.698605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:29.705214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:29.705707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:29.706150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:29.706860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:29.707318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:29.707778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:29.711602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:29.719270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e8cb10e5-f749-4518-8d37-838566127fae tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1551 microversion: 2.1 time: 0.148199 Aug 22 19:50:29.719882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1602/3045] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:29 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1551 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:29.739320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-59857f27-acd8-44a5-a575-d0e4bc73167b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:29.739851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-59857f27-acd8-44a5-a575-d0e4bc73167b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:29.746089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59857f27-acd8-44a5-a575-d0e4bc73167b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:29.746573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59857f27-acd8-44a5-a575-d0e4bc73167b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:29.747005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59857f27-acd8-44a5-a575-d0e4bc73167b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:29.747736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59857f27-acd8-44a5-a575-d0e4bc73167b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:29.748185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59857f27-acd8-44a5-a575-d0e4bc73167b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:29.748642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59857f27-acd8-44a5-a575-d0e4bc73167b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:29.825603 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-59857f27-acd8-44a5-a575-d0e4bc73167b tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089856 Aug 22 19:50:29.826134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1603/3046] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Aug 22 19:50:29 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:50:29.845735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:29.854723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-994c2091-900c-4e84-9f5c-2197beb5037f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.161001 Aug 22 19:50:29.855417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1444/3047] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:29 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:30.782762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-cae31752-a92a-4a76-ab03-b903b1014536 req-48957401-683a-4c63-b974-87ad6242c543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112dfb61-c9eb-465e-88b2-80e8b69e1876", "tag": "cd7e324c-3e1f-4cca-a122-37aec45675a7"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:50:30.792270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-cae31752-a92a-4a76-ab03-b903b1014536 req-48957401-683a-4c63-b974-87ad6242c543 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:30.792778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-cae31752-a92a-4a76-ab03-b903b1014536 req-48957401-683a-4c63-b974-87ad6242c543 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:30.793210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-cae31752-a92a-4a76-ab03-b903b1014536 req-48957401-683a-4c63-b974-87ad6242c543 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:30.805353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-cae31752-a92a-4a76-ab03-b903b1014536 req-48957401-683a-4c63-b974-87ad6242c543 service nova] Creating event network-changed:cd7e324c-3e1f-4cca-a122-37aec45675a7 for instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 on hv-cinder-83538 Aug 22 19:50:30.810323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-cae31752-a92a-4a76-ab03-b903b1014536 req-48957401-683a-4c63-b974-87ad6242c543 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088427 Aug 22 19:50:30.811134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1604/3048] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:50:30.876792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:30.877380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:30.885703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:30.886190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:30.886628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:30.887335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:30.887837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:30.888334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:31.103771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:31.112694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-947d52e5-7d69-4ab4-875b-08f80aa1f3b5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.239803 Aug 22 19:50:31.126512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1445/3049] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:32.135409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:32.136054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:32.142237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:32.142722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:32.143152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:32.143874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:32.144324 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:32.144747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:32.277845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:32.286157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ffba9461-8a40-4d04-814a-a8688ff40a09 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.156142 Aug 22 19:50:32.286728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1605/3050] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:33.307705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:33.308312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:33.314744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:33.315219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:33.315679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:33.316361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:33.316804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:33.317217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:33.446175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:33.454291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e165a937-6f63-4a86-b65b-0456ede843a0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150539 Aug 22 19:50:33.454855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1446/3051] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:34.474693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:34.475348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:34.481763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:34.482240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:34.482678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:34.483359 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:34.483840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:34.484264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:34.613940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:34.624858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-be1f55c8-decd-4e57-a32d-d6dbc2969343 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154026 Aug 22 19:50:34.625428 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1606/3052] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:34 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:35.645888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:35.646510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:35.652916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:35.653399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:35.653833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:35.654524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:35.654976 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:35.655406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:35.787549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:35.795751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c0566ee-e3ce-4730-b99c-5d1980d91b33 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153728 Aug 22 19:50:35.796309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1447/3053] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:36.817223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:36.817834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:36.824977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:36.825460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:36.825904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:36.826597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:36.827052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:36.827579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:36.951851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:36.960016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4ef37041-2c23-48ce-a308-6cfb7e68d215 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.146697 Aug 22 19:50:36.960855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1607/3054] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:37.981186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:37.981792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:37.988335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:37.988809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:37.989238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:37.989917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:37.990363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:37.990825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:38.117600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:38.125790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-047d8440-327d-43b7-a472-efdb58c7f40c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148462 Aug 22 19:50:38.126343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1448/3055] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:39.146886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:39.147502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:39.150139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=56 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:39.155408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:39.155920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:39.156356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:39.157047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:39.157499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:39.157924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:39.504881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:39.513446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-227d1b56-2ff0-4ccf-9322-ea8ac278d71c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.370469 Aug 22 19:50:39.514007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1608/3056] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:40.534237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:40.534945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:40.541750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:40.542217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:40.542653 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:40.543347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:40.543832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:40.544266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:40.674345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:40.683095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f7a511a-56ff-459c-81aa-76ad443b32a9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152751 Aug 22 19:50:40.683687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1449/3057] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:41.704337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:41.704939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:41.711527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:41.712033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:41.712473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:41.713884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:41.714327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:41.714745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:41.843939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:41.852003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d2e9b93f-d3fb-4257-a407-894b308271e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151649 Aug 22 19:50:41.852562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1609/3058] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:42.872966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:42.873608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:42.879974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:42.880458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:42.880892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:42.881576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:42.882029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:42.882461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:43.069984 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:43.078838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f315698-1b36-42ff-b129-53111daebd91 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.209801 Aug 22 19:50:43.079393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1450/3059] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:44.100337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:44.100938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:44.107795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:44.108312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:44.108730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:44.109432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:44.109884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:44.110636 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:44.239068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:44.247582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9aa6a377-7763-4686-8350-6d04b9cad64a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151072 Aug 22 19:50:44.248159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1610/3060] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:45.269184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:45.269798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:45.276457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:45.276940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:45.277377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:45.278856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:45.279309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:45.279762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:45.501722 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:45.509932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15094335-2cc7-4de3-b166-0e134e4d6483 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.244689 Aug 22 19:50:45.510594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1451/3061] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:46.531532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:46.532169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:46.538557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:46.539032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:46.539457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:46.540168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:46.540613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:46.541030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:46.555391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:46.666559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:46.674757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dd115d8c-f581-442f-9554-68d72c7d2c42 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147036 Aug 22 19:50:46.675319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1611/3062] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:47.696399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:47.697035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:47.703932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:47.704412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:47.704848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:47.705531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:47.705985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:47.706405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:47.833980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:47.842969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1dd99174-3583-48f8-a706-c8407f29eaee tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150436 Aug 22 19:50:47.843529 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1452/3063] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:48.864421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:48.865038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:48.871338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:48.871853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:48.872289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:48.872972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:48.873937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:48.874395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:49.004315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:49.012624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9de4e301-fe90-41e2-8272-98c460e4aeb0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152084 Aug 22 19:50:49.013199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1612/3064] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:50.034295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:50.034906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:50.041389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:50.041876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:50.042317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:50.043043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:50.043498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:50.043956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:50.058304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:50.175049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:50.183226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd3e2682-e331-416f-b40c-30bf955ac834 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153438 Aug 22 19:50:50.183817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1453/3065] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:51.205263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:51.205878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:51.212645 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:51.213124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:51.213559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:51.214244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:51.214696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:51.215119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:51.355735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:51.364051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a4e9edb4-2977-478e-aadf-5b186fd74399 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.163228 Aug 22 19:50:51.364617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1613/3066] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:52.384905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:52.385462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:52.387911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=34 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:52.393769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:52.394255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:52.394693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:52.395388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:52.395874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:52.396303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:52.526162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:52.534217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-160e2300-d485-4fc9-bc12-3abd1f40329a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153236 Aug 22 19:50:52.534780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1454/3067] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:52.806962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:52.807564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:52.814485 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:52.814963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:52.815394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:52.816125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:52.816577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:52.817001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:52.841662 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Going to try to terminate instance {{(pid=120639) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:50:52.914375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2b57e4b3-ab9c-4e9d-9ec5-c0bfdddc5bd8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 204 len: 0 microversion: 2.1 time: 0.110791 Aug 22 19:50:52.914802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1614/3068] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:50:52 2022] DELETE /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:50:52.923610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:52.924243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:52.930086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:52.930567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:52.931013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:52.931724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:52.932186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:52.932610 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:53.066878 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:53.074471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa3e98e5-e705-43b7-b207-03d2c3913e7a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1677 microversion: 2.1 time: 0.155327 Aug 22 19:50:53.075036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1455/3069] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:52 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:53.555723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:53.556426 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:53.562422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:53.562901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:53.563950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:53.564634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:53.565084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:53.565506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:53.693205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:53.701345 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e98e1042-3351-4f80-89b2-b5c2fcdbef51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149842 Aug 22 19:50:53.701909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1615/3070] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:54.096252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:54.096850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:54.103258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:54.103769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:54.104210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:54.104899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:54.105349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:54.105810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:54.237046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:54.244678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-219d400e-0196-4b06-baa8-32bd4fa2bd5b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1677 microversion: 2.1 time: 0.152697 Aug 22 19:50:54.245167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1456/3071] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:54 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:54.722498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:54.723296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:54.731051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:54.731534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:54.731993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:54.732690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:54.733135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:54.733556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:54.866403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:54.874515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d45e88bc-ec67-46a2-92d5-61bacb470be0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.156019 Aug 22 19:50:54.875083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1616/3072] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:55.265702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:55.266299 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:55.272518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:55.273002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:55.273472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:55.274164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:55.274615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:55.275269 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:55.374878 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:55.382467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4998e1a6-cf35-4dd4-8b6b-5fa980afb7d8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 200 len: 1612 microversion: 2.1 time: 0.120713 Aug 22 19:50:55.383038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1457/3073] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:55 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 1612 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:55.463065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-f84658c8-3739-41b8-9244-8c2ed18ed253 req-a25ed610-6718-4662-8d95-9f28a352672e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0099938f-5131-4e40-a2d6-7100e471dc41", "name": "network-vif-deleted", "tag": "c116450b-7b8e-4b99-bd93-f535d85ff625"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:50:55.473587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-f84658c8-3739-41b8-9244-8c2ed18ed253 req-a25ed610-6718-4662-8d95-9f28a352672e service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:55.474101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-f84658c8-3739-41b8-9244-8c2ed18ed253 req-a25ed610-6718-4662-8d95-9f28a352672e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:55.474541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-f84658c8-3739-41b8-9244-8c2ed18ed253 req-a25ed610-6718-4662-8d95-9f28a352672e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:55.490010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-f84658c8-3739-41b8-9244-8c2ed18ed253 req-a25ed610-6718-4662-8d95-9f28a352672e service nova] Creating event network-vif-deleted:c116450b-7b8e-4b99-bd93-f535d85ff625 for instance 0099938f-5131-4e40-a2d6-7100e471dc41 on hv-cinder-83538 Aug 22 19:50:55.496499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-f84658c8-3739-41b8-9244-8c2ed18ed253 req-a25ed610-6718-4662-8d95-9f28a352672e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037674 Aug 22 19:50:55.497224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1617/3074] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:50:55.895989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:55.896628 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:55.913144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:55.913635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:55.914069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:55.914771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:55.915218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:55.915637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:56.061110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:56.071220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25f6fd7a-be70-45c5-b95c-47b3c518d86a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.179554 Aug 22 19:50:56.072368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1458/3075] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:56.403767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:56.404427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:56.411403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:56.411917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:56.412354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:56.413065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:56.413516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:56.413940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:56.429164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 HTTP/1.1 Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:50:56.430839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:50:56.432779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '0099938f-5131-4e40-a2d6-7100e471dc41'} Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:50:56.433859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:50:56.435726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:50:56.437291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:50:56.437291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7ee0412d-dbac-420d-bae1-5037dbdfed9e tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 404 len: 111 microversion: 2.1 time: 0.032818 Aug 22 19:50:56.437291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1618/3076] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:56 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:50:56.441548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1fff2e4-0f62-4640-8b63-9534793f7cae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '.version_select at 0x7f66e7df5430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:56.460721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1fff2e4-0f62-4640-8b63-9534793f7cae tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-91703427" status: 202 len: 0 microversion: 2.1 time: 0.023201 Aug 22 19:50:56.461296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1459/3077] 10.222.0.61 () {58 vars in 1215 bytes} [Mon Aug 22 19:50:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-91703427 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:50:57.074228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b065275d-37b6-4607-b3fb-29db4e1e5e43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: .version_select at 0x7f66e421ab80>, body: {"keypair": {"name": "tempest-keypair-794014125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsL6NPbBJ8YmnTUVC8dl78hF/S0Z4d0IeTJ9+fxXY62N9BKCRXmfyIOTuRXTbbjLQDto+OlXq2G8QvaXjiarxPlLwUfKoC6D5zRD/wEoO/0DQIWStTVBUZyk4APO3iW0A=="}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:50:57.090131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-b065275d-37b6-4607-b3fb-29db4e1e5e43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:50:57.093979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-b065275d-37b6-4607-b3fb-29db4e1e5e43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for user 61388384a318473e987ab06426509b69 and project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:50:57.094296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:57.094909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:57.101668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:57.102152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:57.102593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:57.103287 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:57.103768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:57.104196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:57.105683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b065275d-37b6-4607-b3fb-29db4e1e5e43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [e57f4476-3d85-40a7-8a39-01a857abb850] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 19:50:57.236637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:57.245106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-040fe30f-6fa8-43f7-980d-67048dcfb1f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154544 Aug 22 19:50:57.245599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1460/3078] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:58.114254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [None req-b065275d-37b6-4607-b3fb-29db4e1e5e43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [e57f4476-3d85-40a7-8a39-01a857abb850] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 47758. Aug 22 19:50:58.132674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b065275d-37b6-4607-b3fb-29db4e1e5e43 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.062324 Aug 22 19:50:58.133266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1619/3079] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 19:50:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:50:58.266729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:58.268011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:58.274206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:58.274676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:58.275135 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:58.276452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:58.276926 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:58.277356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:58.421457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:58.429734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48f6eebf-68d7-44b8-9f62-557e12df3c4e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.167074 Aug 22 19:50:58.430317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1461/3080] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:50:59.378689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-110007982", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b9dcfeb-0136-4b6f-b975-7fb15dd06c27"}], "security_groups": [{"name": "tempest-securitygroup--1897537072"}], "key_name": "tempest-keypair-794014125", "user_data": "}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:50:59.451936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:59.452800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:50:59.459442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:59.459959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:59.460658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:59.461346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:59.461793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:59.462241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:59.481508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] validate_networks() for [('0b9dcfeb-0136-4b6f-b975-7fb15dd06c27', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:50:59.594766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:50:59.603716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-45e3c40a-36f0-4bef-9f4a-fb5a56180f05 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155612 Aug 22 19:50:59.604305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1462/3081] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:50:59.850135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:50:59.850588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:50:59.851059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:50:59.851467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:50:59.851909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:50:59.860674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:59.861159 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:59.861592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:59.862317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:50:59.862770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:50:59.863201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:50:59.881864 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:50:59.886691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Getting quotas for user 61388384a318473e987ab06426509b69 and project 1e2b975d3d2d45d384b5a8dd92da782f. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:50:59.898276 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:50:59.900599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:50:59.949351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-33c49ea9-2e80-4a1a-81df-feca841bdca2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.575934 Aug 22 19:50:59.951087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1620/3082] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:50:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:50:59.962512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31734735-f75b-48f0-9f28-4c89e2def6e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:50:59.963119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31734735-f75b-48f0-9f28-4c89e2def6e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:00.017493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-31734735-f75b-48f0-9f28-4c89e2def6e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:00.024483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31734735-f75b-48f0-9f28-4c89e2def6e8 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1240 microversion: 2.1 time: 0.066040 Aug 22 19:51:00.025081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1463/3083] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:50:59 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:00.625866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:00.627274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:00.633420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:00.633902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:00.634338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:00.635029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:00.635482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:00.635938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:00.768017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:00.776162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-177a3fa9-fae8-48d0-840c-cfa595d4b653 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154705 Aug 22 19:51:00.776764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1621/3084] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:01.045908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:01.046484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:01.052950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:01.053440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:01.054141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:01.055332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:01.055894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:01.056387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:01.127253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:01.135351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71e19ada-5df0-4783-b9c8-65bf04ecabbc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1310 microversion: 2.1 time: 0.093339 Aug 22 19:51:01.136018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1464/3085] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:01 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:01.798273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:01.798928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:01.805565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:01.806070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:01.806505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:01.807223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:01.807703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:01.808137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:01.951180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:01.963771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7c1cd8a4-a249-42dc-829c-d4f3375131fa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.169839 Aug 22 19:51:01.965042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1622/3086] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:02.156883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:02.158214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:02.164747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:02.165302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:02.165803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:02.166551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:02.167104 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:02.167524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:02.388472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:02.396085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2dbd584-1203-456a-8bdc-611ff5b592e2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1366 microversion: 2.1 time: 0.243016 Aug 22 19:51:02.396715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1465/3087] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:02 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:02.694649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-0ec6c275-22a7-4f60-973a-63385b2e68ed req-72580d9a-6085-4cb4-9b5b-78565502b514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c259a0-8b0f-4898-b134-29190167c01b", "tag": "b0ee54b2-bb05-4962-91ba-c08b65e18668"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:51:02.705845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-0ec6c275-22a7-4f60-973a-63385b2e68ed req-72580d9a-6085-4cb4-9b5b-78565502b514 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:02.706417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-0ec6c275-22a7-4f60-973a-63385b2e68ed req-72580d9a-6085-4cb4-9b5b-78565502b514 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:02.706926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-0ec6c275-22a7-4f60-973a-63385b2e68ed req-72580d9a-6085-4cb4-9b5b-78565502b514 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:02.718856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-0ec6c275-22a7-4f60-973a-63385b2e68ed req-72580d9a-6085-4cb4-9b5b-78565502b514 service nova] Creating event network-changed:b0ee54b2-bb05-4962-91ba-c08b65e18668 for instance 47c259a0-8b0f-4898-b134-29190167c01b on hv-cinder-83538 Aug 22 19:51:02.723555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-0ec6c275-22a7-4f60-973a-63385b2e68ed req-72580d9a-6085-4cb4-9b5b-78565502b514 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032678 Aug 22 19:51:02.724188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1623/3088] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:51:02.985787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:02.986400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:02.992398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:02.992886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:02.993322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:02.994015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:02.994467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:02.994895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:03.198678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:03.207864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77a76268-13ed-4133-b701-ad2e666a4cf6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.225860 Aug 22 19:51:03.209154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1466/3089] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:03.418594 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:03.419287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:03.426067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:03.426537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:03.426965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:03.427666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:03.428112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:03.428528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:03.557991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:03.565591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3858fef0-415a-4d37-a4ef-f50154a7f907 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1366 microversion: 2.1 time: 0.151806 Aug 22 19:51:03.566147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1624/3090] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:03 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:04.229171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:04.229717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:04.236132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:04.237326 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:04.237766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:04.238459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:04.238912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:04.239335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:04.372271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:04.380433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d12ec138-a00a-4d4f-a67d-b45a557efb03 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155212 Aug 22 19:51:04.380997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1467/3091] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:04.586388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:04.586926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:04.593352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:04.593826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:04.594254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:04.594933 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:04.595377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:04.595847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:04.727884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:04.735679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9cee78c2-98cd-4307-bf07-bcba06c5b0af tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1366 microversion: 2.1 time: 0.153421 Aug 22 19:51:04.736239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1625/3092] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:04 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:05.401695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:05.402271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:05.409395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:05.409881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:05.410319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:05.411015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:05.411466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:05.411916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:05.539730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:05.547855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eda1e389-9e5a-4571-be44-8a35a5e233e0 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150001 Aug 22 19:51:05.548426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1468/3093] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:05.757817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:05.758430 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:05.765001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:05.765480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:05.765913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:05.766601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:05.767053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:05.767474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:05.894882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:05.902492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cc2bc4fe-0612-4582-b76d-6528bf6d263a tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1366 microversion: 2.1 time: 0.148516 Aug 22 19:51:05.903056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1626/3094] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:05 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:06.569959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:06.570620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:06.576918 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:06.577394 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:06.577820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:06.578501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:06.578949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:06.579367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:06.705352 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:06.713729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-18dcc0b1-6216-4dcf-bc63-35db63cd2a9b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147667 Aug 22 19:51:06.714289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1469/3095] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:06.923076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:06.923625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:06.930771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:06.931250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:06.931718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:06.932411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:06.932863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:06.933288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:07.062987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:07.070733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1bc80d00-14d2-4685-bcea-e343b0bcc3ba tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1366 microversion: 2.1 time: 0.151605 Aug 22 19:51:07.071302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1627/3096] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:06 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:07.734472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:07.735075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:07.742342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:07.742822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:07.743256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:07.743966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:07.744444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:07.744865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:07.876292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:07.884983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6c65f201-f0ca-4544-9185-7a95c8f0a62e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154315 Aug 22 19:51:07.885558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1470/3097] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:08.091238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:08.091822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:08.098123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:08.098599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:08.099028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:08.099734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:08.100205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:08.100624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:08.227145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:08.234804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ac38494c-24d3-493c-b11a-3229839850ea tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1366 microversion: 2.1 time: 0.147465 Aug 22 19:51:08.235368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1628/3098] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:08 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:08.906449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:08.907055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:08.913967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:08.914458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:08.914879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:08.915710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:08.916246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:08.916702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:09.042841 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:09.050913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f28ef6c-c74f-4b88-9262-ec30a01e6dd9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148291 Aug 22 19:51:09.051530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1471/3099] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:09.256460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:09.257052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:09.259569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:09.265484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:09.265968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:09.266408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:09.267137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:09.267660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:09.268886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:09.384298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b2e38c9c-832d-4dda-9dda-7244d2c007f7 req-f374ccf3-cffd-43ca-99dd-e5f4d4c2bfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c259a0-8b0f-4898-b134-29190167c01b", "name": "network-vif-plugged", "status": "completed", "tag": "b0ee54b2-bb05-4962-91ba-c08b65e18668"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:51:09.395567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b2e38c9c-832d-4dda-9dda-7244d2c007f7 req-f374ccf3-cffd-43ca-99dd-e5f4d4c2bfc0 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:09.396206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b2e38c9c-832d-4dda-9dda-7244d2c007f7 req-f374ccf3-cffd-43ca-99dd-e5f4d4c2bfc0 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:09.396642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b2e38c9c-832d-4dda-9dda-7244d2c007f7 req-f374ccf3-cffd-43ca-99dd-e5f4d4c2bfc0 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:09.401622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:09.402383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:09.411083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b2e38c9c-832d-4dda-9dda-7244d2c007f7 req-f374ccf3-cffd-43ca-99dd-e5f4d4c2bfc0 service nova] Creating event network-vif-plugged:b0ee54b2-bb05-4962-91ba-c08b65e18668 for instance 47c259a0-8b0f-4898-b134-29190167c01b on hv-cinder-83538 Aug 22 19:51:09.412215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-53890ca1-866e-434c-8e72-722256307dc7 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1366 microversion: 2.1 time: 0.158683 Aug 22 19:51:09.413252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1629/3100] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:09 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:09.416359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b2e38c9c-832d-4dda-9dda-7244d2c007f7 req-f374ccf3-cffd-43ca-99dd-e5f4d4c2bfc0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035575 Aug 22 19:51:09.417191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1472/3101] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:51:10.074952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:10.075559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:10.077480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:10.078145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=10 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:10.084463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:10.084940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:10.085638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:10.086319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:10.086765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:10.087183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:10.089848 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:10.220085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:10.228104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-281d9b17-37ae-41cd-8b2b-b07342ca64bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.157294 Aug 22 19:51:10.228666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1630/3102] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:51:10.431009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:10.435084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:10.435804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:10.442855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:10.443336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:10.443802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:10.444491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:10.444945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:10.445368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:10.573672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:10.581361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0cf81a88-dae2-4454-aa92-2a9c991f7521 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1366 microversion: 2.1 time: 0.151755 Aug 22 19:51:10.581929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1473/3103] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:10 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:11.248829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:11.249431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:11.256390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:11.256866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:11.257296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:11.257975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:11.258417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:11.258836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:11.387328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:11.395493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-063cd983-a4ce-4fb6-a5f0-2953f35f7227 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150489 Aug 22 19:51:11.396100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1631/3104] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:11.602697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:11.603343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:11.609876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:11.610363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:11.610806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:11.611506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:11.612589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:11.613094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:11.749715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:11.757579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4701e771-2360-4563-b45a-e92e5ade69b1 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1366 microversion: 2.1 time: 0.158737 Aug 22 19:51:11.758140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1474/3105] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:11 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:12.416356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:12.416948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:12.423197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:12.423701 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:12.424135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:12.425455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:12.425899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:12.426316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:12.555468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:12.563609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f8b5b496-5e35-473b-9fc3-d46fc4668e51 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151154 Aug 22 19:51:12.564188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1632/3106] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:12.778339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:12.778936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:12.785330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:12.785805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:12.786232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:12.786912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:12.787354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:12.787798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:12.914622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:12.922150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5263971a-3e4d-4756-8730-a501844d0972 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1556 microversion: 2.1 time: 0.147769 Aug 22 19:51:12.922705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1475/3107] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:12 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:12.942431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f497acbe-6890-492c-bd44-3bf6dd1d27b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:12.942921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f497acbe-6890-492c-bd44-3bf6dd1d27b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:12.949062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f497acbe-6890-492c-bd44-3bf6dd1d27b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:12.949529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f497acbe-6890-492c-bd44-3bf6dd1d27b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:12.950036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f497acbe-6890-492c-bd44-3bf6dd1d27b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:12.950800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f497acbe-6890-492c-bd44-3bf6dd1d27b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:12.951244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f497acbe-6890-492c-bd44-3bf6dd1d27b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:12.951847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f497acbe-6890-492c-bd44-3bf6dd1d27b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:13.025705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f497acbe-6890-492c-bd44-3bf6dd1d27b5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086997 Aug 22 19:51:13.026302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1633/3108] 10.222.0.61 () {58 vars in 1275 bytes} [Mon Aug 22 19:51:12 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:51:13.584503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:13.585373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:13.591674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:13.592041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:13.592484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:13.593197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:13.593652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:13.594096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:13.832512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:13.840890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ba7333a7-ce8c-447c-ad55-0f462011ee84 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.260214 Aug 22 19:51:13.841452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1476/3109] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:14.016884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-335a490a-0bfd-42de-a336-260d5c0f81cf req-5ff720c3-7b4b-4040-b450-10548dddea07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c259a0-8b0f-4898-b134-29190167c01b", "tag": "b0ee54b2-bb05-4962-91ba-c08b65e18668"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:51:14.026914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-335a490a-0bfd-42de-a336-260d5c0f81cf req-5ff720c3-7b4b-4040-b450-10548dddea07 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:14.027473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-335a490a-0bfd-42de-a336-260d5c0f81cf req-5ff720c3-7b4b-4040-b450-10548dddea07 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:14.028103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-335a490a-0bfd-42de-a336-260d5c0f81cf req-5ff720c3-7b4b-4040-b450-10548dddea07 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:14.040337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-335a490a-0bfd-42de-a336-260d5c0f81cf req-5ff720c3-7b4b-4040-b450-10548dddea07 service nova] Creating event network-changed:b0ee54b2-bb05-4962-91ba-c08b65e18668 for instance 47c259a0-8b0f-4898-b134-29190167c01b on hv-cinder-83538 Aug 22 19:51:14.045510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-335a490a-0bfd-42de-a336-260d5c0f81cf req-5ff720c3-7b4b-4040-b450-10548dddea07 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032902 Aug 22 19:51:14.046204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1634/3110] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:51:14.863048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:14.863708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:14.870277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:14.870766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:14.871208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:14.872045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:14.872503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:14.872933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:15.001423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:15.010199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ca3d381-4bfa-4e92-80f8-28d8a809d4fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151342 Aug 22 19:51:15.010855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1477/3111] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:16.032728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:16.033421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:16.039520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:16.040029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:16.040457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:16.041138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:16.041583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:16.042002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:16.169599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:16.177774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3f9c9a27-c583-46a4-ba84-87c447ed5288 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149729 Aug 22 19:51:16.178341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1635/3112] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:17.199664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:17.200277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:17.206644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:17.207636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:17.208102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:17.208792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:17.209245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:17.209669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:17.340423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:17.349047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-59525e66-3945-45cc-b575-8c6852544a62 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153308 Aug 22 19:51:17.349606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1478/3113] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:18.370046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:18.370661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:18.377101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:18.377581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:18.378010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:18.379192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:18.379637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:18.380079 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:18.513211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:18.522151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bf8a687e-909d-4410-8773-c6f50b6b1aa1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155883 Aug 22 19:51:18.523429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1636/3114] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:19.543106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:19.543855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:19.550270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:19.550748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:19.551179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:19.551887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:19.552336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:19.552755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:19.678197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:19.686276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b40aea7-22de-4a48-bed1-a471412655dc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147047 Aug 22 19:51:19.686835 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1479/3115] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:20.707559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:20.708227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:20.714912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:20.715393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:20.715869 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:20.716558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:20.717009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:20.717434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:20.845961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:20.854200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f01ca6b9-3c6d-4c09-9972-5c7bb44c0632 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150521 Aug 22 19:51:20.854763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1637/3116] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:21.875045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:21.875677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:21.883106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:21.883584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:21.884052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:21.884876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:21.885347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:21.885766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:22.015528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:22.024208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82a9b7e8-8a69-438a-a061-9d669ea3b823 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153020 Aug 22 19:51:22.024768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1480/3117] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:23.045400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:23.046009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:23.052982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:23.053460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:23.053895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:23.054577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:23.055028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:23.055452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:23.187234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:23.196069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6210e65c-cddb-4173-a5c1-cfdabd07b05e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154654 Aug 22 19:51:23.196635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1638/3118] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:24.217080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:24.217618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:24.220013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:24.225210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:24.225688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:24.226186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:24.226899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:24.227347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:24.227823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:24.356143 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:24.364909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08492621-c1bc-4ce5-a031-3aa4d9b03545 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151665 Aug 22 19:51:24.365485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1481/3119] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:25.386044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:25.386604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:25.393015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:25.393495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:25.393929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:25.395117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:25.395562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:25.396009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:25.523572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:25.531735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0380f551-3007-4111-93d9-6799c4cf58a6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149668 Aug 22 19:51:25.532300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1639/3120] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:26.554306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:26.554902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:26.561256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:26.561730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:26.562156 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:26.562837 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:26.563279 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:26.563717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:26.692228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:26.700296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be0356e6-dc34-4634-b10e-ee55e1130ee6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149901 Aug 22 19:51:26.700872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1482/3121] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:27.721935 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:27.723201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:27.729787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:27.730267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:27.730743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:27.731432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:27.732043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:27.732447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:27.860781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:27.868892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0fae8482-3aaf-4d6b-9190-9c119b6c92f8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150823 Aug 22 19:51:27.869463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1640/3122] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:27 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:28.890278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:28.890890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:28.897081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:28.897563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:28.898002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:28.898691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:28.899148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:28.899571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:29.025462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:29.033526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e987a39c-60e6-4756-b5b4-9e7af63b194d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147162 Aug 22 19:51:29.034096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1483/3123] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:30.055127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:30.055760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:30.062170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:30.062647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:30.063083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:30.063803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:30.064251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:30.064673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:30.196448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:30.204779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d79d950f-94b1-4f8c-8c54-19003f8b5e08 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153486 Aug 22 19:51:30.205352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1641/3124] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:31.226398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:31.227010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:31.234167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:31.234645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:31.235074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:31.235796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:31.236243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:31.236658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:31.363240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:31.371417 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-edc8428d-e1a0-4d57-8041-9ba0c2815025 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148855 Aug 22 19:51:31.372015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1484/3125] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:32.393097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:32.393696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:32.400452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:32.400926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:32.401357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:32.402035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:32.402482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:32.402901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:32.527113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:32.535297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0cbe7b0e-8e6c-46c0-8ada-cd8cbae5623b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.146122 Aug 22 19:51:32.535897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1642/3126] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:33.556092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:33.556753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:33.563115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:33.563597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:33.564139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:33.564826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:33.565327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:33.565754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:33.695167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:33.703248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb4032b7-8960-4fb9-9d48-384d6462b781 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151038 Aug 22 19:51:33.703873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1485/3127] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:34.725380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:34.725995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:34.732819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:34.733295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:34.733726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:34.734403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:34.734846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:34.735262 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:34.864840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:34.873238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-51b093d3-9f1a-4367-8baa-d0adf78121d6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152119 Aug 22 19:51:34.873887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1643/3128] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:34 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:35.894842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:35.895465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:35.901953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:35.902438 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:35.902873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:35.903562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:35.904038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:35.904461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:36.032498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:36.041219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7a9a75a-0c42-4537-9dbf-389f928f4fab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150769 Aug 22 19:51:36.041794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1486/3129] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:37.062679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:37.063239 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:37.069667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:37.070140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:37.070570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:37.071250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:37.071720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:37.072137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:37.199620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:37.209568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b0b4920d-c4df-4c65-9113-a824b3c65ef8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151339 Aug 22 19:51:37.210465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1644/3130] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:38.231956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:38.232560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:38.239404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:38.239914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:38.240344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:38.241023 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:38.241468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:38.241886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:38.372745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:38.380899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-688ba310-153b-47f4-b4c0-973f8f1774ff tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152858 Aug 22 19:51:38.381475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1487/3131] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:39.401956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:39.402539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:39.404906 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=32 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:39.410822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:39.411298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:39.411765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:39.412456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:39.412904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:39.413325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:39.548157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:39.556310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7b726e28-6c1b-4c9b-81ba-3dc6cca60a60 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158274 Aug 22 19:51:39.556863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1645/3132] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:40.577617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:40.578239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:40.584613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:40.585353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:40.585785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:40.586465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:40.586908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:40.587324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:40.589824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=92 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:40.719991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:40.729700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83e1d4ab-098c-451e-ad77-3e0429a21c40 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155860 Aug 22 19:51:40.730658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1488/3133] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:41.751913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:41.752535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:41.759665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:41.760151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:41.760585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:41.761263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:41.761708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:41.762123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:41.764738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=90 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:41.887114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:41.895171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-35f6ceb6-0932-4785-b977-a06e578ab1c9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147100 Aug 22 19:51:41.895743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1646/3134] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:42.916563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:42.917175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:42.923475 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:42.923991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:42.924433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:42.925117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:42.926213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:42.926636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:43.052080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:43.060159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-140a8c80-0e63-4591-893d-4d50e1daf98f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147490 Aug 22 19:51:43.060733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1489/3135] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:44.081306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:44.081918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:44.088784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:44.089270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:44.089807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:44.090495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:44.090950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:44.091375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:44.220285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:44.228629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d027a892-ee1f-4fe4-a518-23c066e44f6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151060 Aug 22 19:51:44.229158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1647/3136] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:45.250445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:45.251055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:45.258096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:45.258584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:45.259022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:45.259740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:45.260196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:45.260622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:45.391061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:45.399730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-88ea32ac-3398-4689-911e-456ce159cb35 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153207 Aug 22 19:51:45.400324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1490/3137] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:46.420672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:46.421241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:46.428126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:46.428606 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:46.429041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:46.429753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:46.430203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:46.430626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:46.560688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:46.569386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-34938c59-ee62-415c-afbd-eddb2aecae5a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152693 Aug 22 19:51:46.569949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1648/3138] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:47.590546 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:47.591179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:47.597658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:47.598144 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:47.598613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:47.599306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:47.599791 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:47.600218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:48.043550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:48.052064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09eb1100-65f2-4836-8d8c-6e4aa2af70a3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.465194 Aug 22 19:51:48.052668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1491/3139] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:49.073294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:49.073920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:49.080673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:49.081153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:49.081584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:49.082275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:49.082728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:49.083821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:49.208845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:49.217315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-90da90d1-a8c2-404e-b810-a981666a27b6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147868 Aug 22 19:51:49.217882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1649/3140] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:50.238668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:50.239262 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:50.245854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:50.246328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:50.246755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:50.247431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:50.247920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:50.248340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:50.378405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:50.387019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8395c36-4c47-439a-9dd0-543ee4f0a302 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152374 Aug 22 19:51:50.387574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1492/3141] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:51.408402 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:51.408977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:51.415267 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:51.415779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:51.416220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:51.416898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:51.417347 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:51.417766 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:51.553401 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:51.561779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-43407260-5edd-4e5f-a5ae-db5e37f6a655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.157272 Aug 22 19:51:51.562353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1650/3142] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:52.584053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:52.584656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:52.591522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:52.592036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:52.592476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:52.593164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:52.593618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:52.594071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:52.719986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:52.728121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8a54462-2635-4d49-a022-e6c5c8d12b27 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148443 Aug 22 19:51:52.728693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1493/3143] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:53.749094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:53.749697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:53.756840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:53.757314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:53.757747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:53.758433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:53.758938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:53.759363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:53.885279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:53.893522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-588eec26-8181-4026-ab42-c5668feab3f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148261 Aug 22 19:51:53.894086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1651/3144] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:54.914834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:54.915399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:54.917762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=26 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:54.923127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:54.923613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:54.924074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:54.924770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:54.925220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:54.925833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:55.055721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:55.063795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e98bcd37-41bc-44b6-bba6-3445d2ffafa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152882 Aug 22 19:51:55.064359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1494/3145] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:56.085367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:56.085974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:56.092521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:56.092995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:56.093424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:56.094102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:56.094547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:56.094963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:56.219083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:56.227066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f08a1ba8-a7b6-451d-9419-e666b129d747 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.145877 Aug 22 19:51:56.227633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1652/3146] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:57.247952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:57.248570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:57.255095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:57.255578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:57.256043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:57.256731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:57.257184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:57.257605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:57.386113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:57.394272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15d8690d-7ebc-48fb-99fb-98db9f48195a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150127 Aug 22 19:51:57.394831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1495/3147] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:57.602960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-13e9a65c-c14f-4299-859d-7570953fec6c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:57.603492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-13e9a65c-c14f-4299-859d-7570953fec6c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:57.609398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13e9a65c-c14f-4299-859d-7570953fec6c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:57.609882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13e9a65c-c14f-4299-859d-7570953fec6c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:57.610320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13e9a65c-c14f-4299-859d-7570953fec6c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:57.611010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13e9a65c-c14f-4299-859d-7570953fec6c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:57.611467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13e9a65c-c14f-4299-859d-7570953fec6c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:57.611919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-13e9a65c-c14f-4299-859d-7570953fec6c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:57.635184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-13e9a65c-c14f-4299-859d-7570953fec6c tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876/ips" status: 200 len: 147 microversion: 2.1 time: 0.117599 Aug 22 19:51:57.635890 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1653/3148] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:51:57 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876/ips => generated 147 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:51:58.416393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:58.416968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:58.422996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:58.423477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:58.423956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:58.424646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:58.425100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:58.425528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:58.553309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:58.561472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d858dde-41e5-4f26-a594-cee5dffd4f86 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149592 Aug 22 19:51:58.562031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1496/3149] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:51:59.582278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:51:59.582886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:51:59.590065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:59.590535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:59.590965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:59.591661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:51:59.592294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:51:59.592719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:51:59.721270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:51:59.729319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6dcd9958-8647-4378-b614-b9baba349fca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150843 Aug 22 19:51:59.730061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1654/3150] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:51:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:00.751236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:00.751875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:00.758581 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:00.759064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:00.759499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:00.760240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:00.760684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:00.761110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:00.892695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:00.901312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc01f326-7593-425f-a8b1-0953ee758fc8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153932 Aug 22 19:52:00.901873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1497/3151] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:01.921995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:01.922637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:01.928883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:01.929362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:01.929793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:01.930508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:01.931460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:01.931911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:02.059264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:02.067270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6744b3e3-6409-4180-94b6-763907092e82 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149185 Aug 22 19:52:02.067865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1655/3152] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:03.089671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:03.090267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:03.096692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:03.097176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:03.097642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:03.098336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:03.098792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:03.099220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:03.225038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:03.233178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26d7a668-6b62-4ec6-80e4-264359943158 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148273 Aug 22 19:52:03.233737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1498/3153] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:04.254534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:04.255072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:04.262058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:04.262537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:04.262971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:04.263671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:04.264128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:04.264549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:04.394289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:04.402988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c355c14b-b4b9-428e-a2f5-c677e9c4618c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152355 Aug 22 19:52:04.403554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1656/3154] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:05.424660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:05.425211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:05.432202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:05.432679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:05.433112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:05.433789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:05.434234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:05.434652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:05.563938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:05.572560 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6540f748-def9-46d1-9bc1-b855cf17198b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151830 Aug 22 19:52:05.573131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1499/3155] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:06.594247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:06.594860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:06.601494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:06.601968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:06.602399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:06.603673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:06.604122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:06.604538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:06.729825 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:06.738681 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0e2156ce-c0ed-4a04-94ec-5da13023406a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148286 Aug 22 19:52:06.739242 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1657/3156] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:07.759541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:07.760632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:07.767079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:07.767552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:07.768011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:07.768695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:07.769139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:07.769566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:07.898389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:07.907159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90eb1cfb-03b7-462d-a9c0-8b7efb1a30bb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151492 Aug 22 19:52:07.907742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1500/3157] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:08.928252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:08.928870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:08.935960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:08.936440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:08.936876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:08.937566 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:08.938019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:08.938444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:09.066051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:09.074091 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1ff9038d-8525-4cfb-8fce-0efae80b6403 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149677 Aug 22 19:52:09.074652 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1658/3158] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:10.095059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:10.095702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:10.102276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:10.102757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:10.103190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:10.104640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:10.105097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:10.105522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:10.235049 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:10.243308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-73f2f31f-b73b-400f-b2a3-c12e3e7e5ef3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152031 Aug 22 19:52:10.243840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1501/3159] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:11.264171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:11.264785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:11.267072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=28 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:11.272511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:11.272997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:11.273436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:11.274127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:11.274579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:11.275004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:11.401774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:11.409850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-101f9146-d607-4745-b1eb-06ef6b12b599 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149532 Aug 22 19:52:11.410412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1659/3160] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:12.431625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:12.432776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:12.439168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:12.439661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:12.440105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:12.440788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:12.441233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:12.441650 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:12.444157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=84 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:12.569457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:12.578098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8328c9e7-a4e7-4ae2-ac48-12c5ce7733e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150344 Aug 22 19:52:12.578657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1502/3161] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:13.600005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:13.600702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:13.607409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:13.608222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:13.608651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:13.609972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:13.610749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:13.611506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:13.618705 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=82 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:13.744146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:13.752791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5a793a15-3c6a-4f39-ba93-7c15527808fb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.156945 Aug 22 19:52:13.753351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1660/3162] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:14.773866 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:14.774480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:14.781224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:14.781710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:14.782164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:14.782862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:14.783314 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:14.783787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:14.953493 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:14.961772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62fd76a0-0972-4fc4-8894-71bd79d7369e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.191780 Aug 22 19:52:14.962329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1503/3163] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:15.982617 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:15.983297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:15.989751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:15.990077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:15.990509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:15.991189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:15.991680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:15.992067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:16.123016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:16.131088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6de3a7b0-5267-4539-a060-4d0daabac15d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152367 Aug 22 19:52:16.131657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1661/3164] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:15 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:17.152721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:17.153332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:17.159843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:17.160327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:17.160761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:17.161448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:17.161901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:17.162322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:17.292840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:17.301067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a0c8f9d-0d0e-4376-8262-b23f9c7c8a47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152317 Aug 22 19:52:17.301624 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1504/3165] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:18.321896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:18.323055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:18.329526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:18.330000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:18.330433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:18.331110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:18.331555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:18.332011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:18.501931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:18.510837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c5cb0fbc-029d-400d-861a-6013ae66b2f3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.192764 Aug 22 19:52:18.511611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1662/3166] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:19.532463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:19.533078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:19.539574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:19.540091 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:19.540531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:19.541233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:19.541687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:19.542117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:19.668622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:19.676936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-84c0afa2-e2a1-49f4-920b-0307f8183f0a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148417 Aug 22 19:52:19.677498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1505/3167] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:20.698829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:20.699511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:20.705868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:20.706350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:20.706785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:20.707474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:20.707946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:20.708368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:20.837109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:20.845354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0661692e-65d2-4e72-8b65-3468aee796df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151112 Aug 22 19:52:20.845919 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1663/3168] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:21.866213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:21.866886 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:21.873857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:21.874334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:21.874766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:21.875445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:21.875928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:21.876348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:22.008702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:22.016895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a2178e6-f203-4492-9137-31926adea98a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154539 Aug 22 19:52:22.017485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1506/3169] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:23.038031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:23.038644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:23.045683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:23.046160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:23.046627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:23.047311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:23.047787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:23.048212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:23.173234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:23.181467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b5d39b0c-cd26-4724-85a5-2ccac4dde935 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147248 Aug 22 19:52:23.182028 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1664/3170] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:23 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:24.204064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:24.204672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:24.211268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:24.211771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:24.212242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:24.213565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:24.214015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:24.214434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:24.340782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:24.348902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3ef846ef-9969-4fff-97dd-3599da8ec84e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148682 Aug 22 19:52:24.349464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1507/3171] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:25.370356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:25.370960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:25.377663 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:25.378149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:25.378590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:25.379291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:25.379768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:25.380196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:25.528059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:25.536128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ad395603-b892-4bcd-92b7-fd97fa324c4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.170271 Aug 22 19:52:25.536692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1665/3172] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:26.557950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:26.558564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:26.560857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=28 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:26.566100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:26.566578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:26.567008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:26.567713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:26.568163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:26.568584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:26.696575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:26.705273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f729b36d-9a42-44f4-99fb-b884d8b4c54d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151654 Aug 22 19:52:26.705848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1508/3173] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:27.726072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:27.726999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:27.733500 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:27.733856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:27.734270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:27.734961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:27.735411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:27.735868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:27.864623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:27.873230 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cee244aa-578a-4efe-bd7c-db88c66b075f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151013 Aug 22 19:52:27.873808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1666/3174] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:27 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:28.893779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:28.894385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:28.900434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:28.900906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:28.901335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:28.902495 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:28.902947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:28.903369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:29.032470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:29.040481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cece5d7a-58ae-48c0-a01f-288eca365cbd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150545 Aug 22 19:52:29.041046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1509/3175] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:29.093261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fbdede51-20aa-4d7f-aba2-43f047b9948b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:29.093754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fbdede51-20aa-4d7f-aba2-43f047b9948b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:29.100207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbdede51-20aa-4d7f-aba2-43f047b9948b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:29.100677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbdede51-20aa-4d7f-aba2-43f047b9948b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:29.101102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbdede51-20aa-4d7f-aba2-43f047b9948b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:29.101774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbdede51-20aa-4d7f-aba2-43f047b9948b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:29.102231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbdede51-20aa-4d7f-aba2-43f047b9948b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:29.102626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fbdede51-20aa-4d7f-aba2-43f047b9948b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:29.125791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fbdede51-20aa-4d7f-aba2-43f047b9948b tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b/ips" status: 200 len: 150 microversion: 2.1 time: 0.036914 Aug 22 19:52:29.126364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1667/3176] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:52:29 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:52:30.061959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:30.062575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:30.069017 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:30.069500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:30.069945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:30.070633 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:30.071084 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:30.071508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:30.199432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:30.208225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20c4c5bd-e4da-4f83-b58c-dd855e477b7c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150112 Aug 22 19:52:30.208786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1510/3177] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:31.229767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:31.230421 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:31.237429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:31.237909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:31.238341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:31.239026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:31.239474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:31.239937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:31.366815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:31.374939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9c3c704d-60b1-48de-9110-1472979d53c3 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149068 Aug 22 19:52:31.375531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1668/3178] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:32.396955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:32.397513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:32.405065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:32.405547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:32.405981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:32.406670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:32.407119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:32.407536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:32.538769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:32.546811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9334456e-e44e-42fc-abd6-6b3b2def3eef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153791 Aug 22 19:52:32.547365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1511/3179] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:33.568326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:33.568979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:33.574789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:33.575265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:33.575724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:33.577071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:33.577519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:33.577937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:33.707610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:33.716044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-18663c5a-0e4c-42db-a9af-99eff0d68a7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151702 Aug 22 19:52:33.716609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1669/3180] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:34.737027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:34.737637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:34.744195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:34.744676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:34.745116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:34.745802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:34.746252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:34.746675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:34.873756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:34.881873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf2a48ec-90ef-40a4-8fec-00d9de53518d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148743 Aug 22 19:52:34.882432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1512/3181] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:34 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:35.903374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:35.904015 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:35.910434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:35.910893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:35.911330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:35.912051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:35.912504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:35.912925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:36.037165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:36.045820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4335165e-c710-4214-8bf7-8c8841b91398 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.145832 Aug 22 19:52:36.046382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1670/3182] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:35 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:37.067249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:37.067833 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:37.074165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:37.074648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:37.075073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:37.075778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:37.077223 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:37.077651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:37.208587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:37.216845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3730f65c-6e9b-41f0-9e8e-979c84a6a961 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153886 Aug 22 19:52:37.217407 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1513/3183] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:38.238529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:38.239132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:38.245494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:38.245966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:38.246393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:38.247075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:38.247516 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:38.247965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:38.375513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:38.383576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ac3b90a3-74b5-4635-99ca-51124e83a0ae tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148943 Aug 22 19:52:38.384172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1671/3184] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:39.405226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:39.405748 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:39.412108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:39.412587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:39.413019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:39.413694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:39.414141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:39.414558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:39.547507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:39.555812 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cba87d69-6c49-474b-b81e-07024ae98c2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154444 Aug 22 19:52:39.556380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1514/3185] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:40.577809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:40.578438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:40.585165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:40.585638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:40.586070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:40.586748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:40.587189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:40.587604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:40.712778 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:40.721164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-247bdccf-28e3-4f1e-9ed8-e3c12294083f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147663 Aug 22 19:52:40.721740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1672/3186] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:41.742919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:41.743523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:41.750903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:41.751474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:41.752025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:41.752872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:41.753371 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:41.753848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:41.883672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:41.891757 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67ce0200-e5bd-4189-995e-d9e587973931 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153059 Aug 22 19:52:41.892321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1515/3187] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:42.912556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:42.913170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:42.915446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=28 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:42.920736 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:42.921206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:42.921635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:42.922309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:42.922751 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:42.923167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:43.046511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:43.054629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cddd24f5-df58-4752-8544-36abac91fcfd tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.145872 Aug 22 19:52:43.055201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1673/3188] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:42 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:44.076385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:44.076992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:44.083924 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:44.084400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:44.085082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:44.085760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:44.086207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:44.086626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:44.089313 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=84 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:44.218960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:44.227283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1929d146-d817-4222-9260-74dff8dcb833 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155023 Aug 22 19:52:44.227892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1516/3189] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:45.248471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:45.249555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:45.256001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:45.256482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:45.256914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:45.257595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:45.258042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:45.258461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:45.262319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=82 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:45.389246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:45.397895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1a8320d7-9e3d-4159-aa8f-7566dd369a29 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153283 Aug 22 19:52:45.398455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1674/3190] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:46.418340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:46.418870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:46.426210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:46.426688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:46.427120 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:46.427842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:46.428296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:46.428719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:46.554218 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:46.562948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93ea4d64-d000-4804-8275-ca95e710a27e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148686 Aug 22 19:52:46.563512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1517/3191] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:47.584218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:47.585135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:47.591468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:47.591978 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:47.592405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:47.593094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:47.593529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:47.593950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:47.721619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:47.729808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-05cfd546-c7f6-4237-ae9f-52f491148481 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149428 Aug 22 19:52:47.730567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1675/3192] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:48.751230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:48.751884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:48.758289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:48.758747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:48.759180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:48.759891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:48.760358 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:48.760760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:48.895197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:48.903295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ceb954d0-13f4-4858-92df-17399b65ac9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155954 Aug 22 19:52:48.903884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1518/3193] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:49.924753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:49.925365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:49.931709 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:49.932191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:49.932630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:49.933317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:49.933768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:49.934187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:50.061354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:50.070137 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f8ca2f74-0170-487d-a328-21c79cb658be tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149280 Aug 22 19:52:50.070699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1676/3194] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:49 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:51.091448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:51.092108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:51.098617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:51.099099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:51.099539 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:51.100250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:51.100705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:51.101129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:51.229060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:51.238078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0aa7c8b1-f5c9-4e31-8ce3-6feb94541b6e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150493 Aug 22 19:52:51.238655 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1519/3195] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:52.258380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:52.258952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:52.266393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:52.266878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:52.267319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:52.268036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:52.268492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:52.268920 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:52.394168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:52.402211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-99e677f4-2a6b-4fca-b925-6679e9a8c713 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147746 Aug 22 19:52:52.402770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1677/3196] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:53.423745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:53.424376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:53.430706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:53.431184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:53.431619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:53.432331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:53.432789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:53.433210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:53.568171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:53.576246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1afd1c2a-8387-4e2c-b831-9147f54220df tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.157037 Aug 22 19:52:53.576808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1520/3197] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:54.597327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:54.597944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:54.604365 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:54.604841 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:54.605277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:54.605959 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:54.606408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:54.606831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:54.731098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:54.740283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-77a78fc7-e92c-4800-bc0f-0614a7b37586 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.146768 Aug 22 19:52:54.740852 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1678/3198] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:55.761907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:55.762500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:55.768951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:55.769427 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:55.769862 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:55.771153 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:55.771630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:55.772102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:55.900162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:55.908993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b8f66d0-363a-4af5-b640-d2dfd2db163c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150939 Aug 22 19:52:55.909552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1521/3199] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:55 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:56.930285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:56.930894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:56.937977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:56.938465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:56.939021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:56.939743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:56.940195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:56.940625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:57.066896 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:57.074929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-724b2804-89ff-4b13-b447-fa2e35fd4a10 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148488 Aug 22 19:52:57.075491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1679/3200] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:57.712619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:57.713187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:57.715406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=28 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:57.720825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:57.721304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:57.721734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:57.722413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:57.722860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:57.723280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:57.748303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:52:57.825379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c717fe71-6b54-41eb-a794-dbfb2d732821 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "DELETE /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 204 len: 0 microversion: 2.1 time: 0.116612 Aug 22 19:52:57.826075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1522/3201] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:52:57 2022] DELETE /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:52:57.834328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:57.835231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:57.841237 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:57.841711 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:57.842140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:57.842827 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:57.843275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:57.843760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:57.970275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:57.978044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-32979074-52c5-454c-a60c-474bd7b3009a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1676 microversion: 2.1 time: 0.147601 Aug 22 19:52:57.978605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1680/3202] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:57 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:58.096050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:58.096768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:58.102609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:58.103083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:58.103526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:58.104210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:58.104656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:58.105095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:58.231508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:58.239913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2068cda0-0cf8-4664-8ca3-1286386d2ea8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148229 Aug 22 19:52:58.240587 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1523/3203] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:58.999241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:58.999997 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:59.006396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:59.006876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:59.007315 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:59.008035 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:59.008491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:59.008916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:59.141916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:59.149776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b4ae413f-3216-40af-ae62-4e890aa61785 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1676 microversion: 2.1 time: 0.154539 Aug 22 19:52:59.150340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1681/3204] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:58 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:52:59.261651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:52:59.262188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:52:59.269068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:59.269554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:59.269994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:59.270686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:52:59.271136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:52:59.271564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:52:59.416730 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:52:59.425746 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9cd5953b-eacf-4257-aefc-507f2bec679f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.168303 Aug 22 19:52:59.426322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1524/3205] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:52:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:00.171476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:00.172787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:00.179329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:00.179849 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:00.180280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:00.180977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:00.181425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:00.181839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:00.248559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d0ab6d1a724547b8c643287df897da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca75caa807b445f486899173277b5051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:00.257513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b77a0684-7da2-4120-bdef-f26b3d3d91a3 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 200 len: 1608 microversion: 2.1 time: 0.090208 Aug 22 19:53:00.258094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1682/3206] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:00 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 1608 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:00.386393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2ecaaa56-d0b8-46b0-bf84-2b9d227e96f2 req-cf2d3598-8230-4752-8948-c6e419ff223e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112dfb61-c9eb-465e-88b2-80e8b69e1876", "name": "network-vif-deleted", "tag": "cd7e324c-3e1f-4cca-a122-37aec45675a7"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:53:00.397349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2ecaaa56-d0b8-46b0-bf84-2b9d227e96f2 req-cf2d3598-8230-4752-8948-c6e419ff223e service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:00.398534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2ecaaa56-d0b8-46b0-bf84-2b9d227e96f2 req-cf2d3598-8230-4752-8948-c6e419ff223e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:00.398534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2ecaaa56-d0b8-46b0-bf84-2b9d227e96f2 req-cf2d3598-8230-4752-8948-c6e419ff223e service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:00.412590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2ecaaa56-d0b8-46b0-bf84-2b9d227e96f2 req-cf2d3598-8230-4752-8948-c6e419ff223e service nova] Creating event network-vif-deleted:cd7e324c-3e1f-4cca-a122-37aec45675a7 for instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 on hv-cinder-83538 Aug 22 19:53:00.417955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2ecaaa56-d0b8-46b0-bf84-2b9d227e96f2 req-cf2d3598-8230-4752-8948-c6e419ff223e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035116 Aug 22 19:53:00.421566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1525/3207] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:53:00.450388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:00.454965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:00.465833 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:00.466934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:00.467951 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:00.470804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:00.472018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:00.472941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:00.693583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:00.702277 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6c20e87b-8751-4e7d-870c-285a652761d7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.258594 Aug 22 19:53:00.702950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1683/3208] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:01.279250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:01.280442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:01.288688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:01.289347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:01.290059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:01.290875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:01.291400 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:01.291916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:01.309387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] HTTP exception thrown: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Request method failure captured: Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 HTTP/1.1 Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aA9Ay6GWGQ0MVne0HlegmkVSvIeLGXdreDrlApfgpwRhocJOM5UI2pZQI8_zlvhmXcYz3rLSSIwjlXfDzvwq932K5Sty2YrJQqSgwIa6euu5R3KtOd2_1BADojkUjj7kE5tE1V5bg3I7A60IG3OWpFQR3DrSJiTfUYSKlMTas2ReA Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: ca75caa807b445f486899173277b5051 Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:53:01.311056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ca75caa807b445f486899173277b5051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ca75caa807b445f486899173277b5051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}] Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ca75caa807b445f486899173277b5051 Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 21d0ab6d1a724547b8c643287df897da Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:01.313198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '112dfb61-c9eb-465e-88b2-80e8b69e1876'} Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:01.314014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:01.315270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:01.316618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Returning 404 to user: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:01.316618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ab17395-28eb-4537-860a-1a9834056cb8 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 404 len: 111 microversion: 2.1 time: 0.037634 Aug 22 19:53:01.317317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1526/3209] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:01 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:53:01.322351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-30d0dc54-b36e-4f2f-841d-e821a8f5f3e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '.version_select at 0x7f66df7d2790>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:01.346969 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-30d0dc54-b36e-4f2f-841d-e821a8f5f3e7 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832813430" status: 202 len: 0 microversion: 2.1 time: 0.028528 Aug 22 19:53:01.347552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1684/3210] 10.222.0.61 () {58 vars in 1221 bytes} [Mon Aug 22 19:53:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832813430 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:53:01.724344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:01.724935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:01.731619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:01.732132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:01.732594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:01.733257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:01.733708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:01.734164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:01.917362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:01.926175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5617b77e-105c-4324-8c46-15f6ca2a7428 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.205689 Aug 22 19:53:01.926857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1527/3211] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:02.298672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:02.299170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:02.305504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:02.305984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:02.306420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:02.307109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:02.307562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:02.308012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:02.322341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] HTTP exception thrown: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Request method failure captured: Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 HTTP/1.1 Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aA9Ay6GWGQ0MVne0HlegmkVSvIeLGXdreDrlApfgpwRhocJOM5UI2pZQI8_zlvhmXcYz3rLSSIwjlXfDzvwq932K5Sty2YrJQqSgwIa6euu5R3KtOd2_1BADojkUjj7kE5tE1V5bg3I7A60IG3OWpFQR3DrSJiTfUYSKlMTas2ReA Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: ca75caa807b445f486899173277b5051 Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:53:02.324036 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ca75caa807b445f486899173277b5051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ca75caa807b445f486899173277b5051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}] Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: ca75caa807b445f486899173277b5051 Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 21d0ab6d1a724547b8c643287df897da Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.326754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '112dfb61-c9eb-465e-88b2-80e8b69e1876'} Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:02.328290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.330529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.332486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Returning 404 to user: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:02.332486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a2dd89dc-a63f-40fc-a940-e5e00858fccb tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "DELETE /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 404 len: 111 microversion: 2.1 time: 0.031604 Aug 22 19:53:02.332486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1685/3212] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:53:02 2022] DELETE /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:53:02.336021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:02.336629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 112dfb61-c9eb-465e-88b2-80e8b69e1876] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:02.342676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:02.343174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:02.343605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:02.344323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:02.344771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:02.345193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:02.358395 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] HTTP exception thrown: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Request method failure captured: Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 HTTP/1.1 Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aA9Ay6GWGQ0MVne0HlegmkVSvIeLGXdreDrlApfgpwRhocJOM5UI2pZQI8_zlvhmXcYz3rLSSIwjlXfDzvwq932K5Sty2YrJQqSgwIa6euu5R3KtOd2_1BADojkUjj7kE5tE1V5bg3I7A60IG3OWpFQR3DrSJiTfUYSKlMTas2ReA Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: ca75caa807b445f486899173277b5051 Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:53:02.360469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ca75caa807b445f486899173277b5051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ca75caa807b445f486899173277b5051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}] Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ca75caa807b445f486899173277b5051 Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 21d0ab6d1a724547b8c643287df897da Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.362437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '112dfb61-c9eb-465e-88b2-80e8b69e1876'} Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:02.363943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. Aug 22 19:53:02.366150 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:02.368054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Returning 404 to user: Instance 112dfb61-c9eb-465e-88b2-80e8b69e1876 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:02.368054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea617ef4-adea-4e29-bba6-1bd5e7119a57 tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876" status: 404 len: 111 microversion: 2.1 time: 0.030005 Aug 22 19:53:02.368054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1528/3213] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:02 2022] GET /compute/v2.1/servers/112dfb61-c9eb-465e-88b2-80e8b69e1876 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:53:02.959295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:02.960193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:02.966309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:02.966787 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:02.967221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:02.967938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:02.968390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:02.968814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:03.100000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:03.108533 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-039d6d17-dc5e-432a-8980-38656f95a0ef tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153114 Aug 22 19:53:03.109105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1686/3214] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:02 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:04.130751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:04.131369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:04.137951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:04.138424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:04.138856 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:04.139544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:04.140027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:04.140497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:04.282055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:04.290304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ef0d149-3bc8-42eb-b553-950ce862e950 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.163406 Aug 22 19:53:04.290863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1529/3215] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:05.316005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:05.317138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:05.327770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:05.328625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:05.329386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:05.330583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:05.331379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:05.332145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:05.470626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:05.478918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e9ed2777-d63f-45c1-8189-b8ed7cdbf671 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.170815 Aug 22 19:53:05.479517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1687/3216] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:06.503437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:06.504081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:06.510799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:06.511286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:06.511754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:06.512460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:06.512919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:06.513345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:06.651413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:06.659672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c9d47ec-6b04-457e-8941-080ea6f8120b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.162897 Aug 22 19:53:06.660245 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1530/3217] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:07.681475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:07.682087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:07.688612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:07.689085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:07.689515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:07.690207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:07.690657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:07.691074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:07.822707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:07.831144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d7ab225d-0ca8-483e-a407-05e62866c18e tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153452 Aug 22 19:53:07.831762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1688/3218] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:07 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:08.853213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:08.853844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:08.861911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:08.862397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:08.862830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:08.863524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:08.864000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:08.864423 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:09.002788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:09.011078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-98dccc3a-ce7f-4155-9d3a-0ffe9311d340 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.161709 Aug 22 19:53:09.011661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1531/3219] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:53:10.032810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:10.033414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:10.039883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:10.040361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:10.040789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:10.041471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:10.041913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:10.042333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:10.168680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:10.176967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5c755391-8f20-4a62-8795-703c468641ca tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148369 Aug 22 19:53:10.177534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1689/3220] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:11.198820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:11.199428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:11.206422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:11.206906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:11.207345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:11.208067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:11.208533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:11.208960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:11.336338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:11.345078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f485570b-ee2e-4da4-b3b5-f1959a0a20ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150157 Aug 22 19:53:11.345639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1532/3221] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:12.366422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:12.366963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:12.373573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:12.374047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:12.374476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:12.375176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:12.375678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:12.376085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:12.503916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:12.512005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-07b87b5d-0cbb-4822-b6b6-1dbf0d361d6a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149501 Aug 22 19:53:12.512563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1690/3222] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:13.534935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:13.536391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:13.542432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:13.542922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:13.543363 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:13.544100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:13.544553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:13.544981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:13.547884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:13.682462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:13.691276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6979a2fd-78dc-47b3-ba7d-fb6915934ba2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.161086 Aug 22 19:53:13.691892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1533/3223] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:14.714022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:14.714624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:14.716964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:14.722916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:14.723436 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:14.723932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:14.724620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:14.725066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:14.725484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:14.858184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:14.866369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1518a3e8-d4ee-4b03-ba36-b1a49010397f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.156704 Aug 22 19:53:14.866938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1691/3224] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:14 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:15.887117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:15.887687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:15.894709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:15.895197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:15.895636 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:15.896360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:15.896817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:15.897240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:16.030174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:16.038586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-898ee20e-5d9c-4c92-bbf9-42c4ee08122c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155384 Aug 22 19:53:16.039222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1534/3225] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:15 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:17.059873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:17.060495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:17.067009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:17.067492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:17.067957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:17.068653 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:17.069109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:17.069532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:17.072147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=98 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:17.201857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:17.210946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1a23c8c8-126c-4c18-aa79-6ecce084cf97 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154961 Aug 22 19:53:17.211515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1692/3226] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:18.232643 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:18.233259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:18.240497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:18.240985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:18.241426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:18.242119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:18.242608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:18.243037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:18.376756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:18.385043 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf96fb57-c146-4616-8b95-344ea65f124c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.156232 Aug 22 19:53:18.385621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1535/3227] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:18 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:19.406804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:19.407422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:19.414103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:19.414593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:19.415030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:19.415755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:19.416209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:19.416640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:19.554807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:19.564009 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a14e3987-988c-41f4-917a-f25a4412207b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.161086 Aug 22 19:53:19.564593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1693/3228] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:19 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:20.585570 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:20.586179 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:20.592717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:20.593237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:20.593638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:20.594337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:20.594803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:20.595230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:20.726420 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:20.734834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7c2c500-c26a-4ef6-9b96-dfbc76f427b8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153443 Aug 22 19:53:20.735469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1536/3229] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:20 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:21.755976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:21.756598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:21.763062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:21.763543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:21.764012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:21.764704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:21.765675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:21.766099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:21.895870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:21.903973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b1f50cae-9b43-4f64-8952-508d617c15cf tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151887 Aug 22 19:53:21.904537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1694/3230] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:21 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:22.931859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:22.932469 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:22.938865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:22.939349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:22.939826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:22.940525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:22.940978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:22.941402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:23.070953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:23.079709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9850e97-62b8-45ef-a33a-fe23754be2c6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151717 Aug 22 19:53:23.080273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1537/3231] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:22 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:24.101573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:24.102181 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:24.109370 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:24.109853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:24.110284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:24.110983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:24.111439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:24.111897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:24.247610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:24.256476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3143548b-2eff-4dc1-9ee8-92edb17e89a8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158730 Aug 22 19:53:24.257041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1695/3232] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:24 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:24.961233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:53:24.961787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:53:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:53:25.278300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:25.278825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:25.285533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:25.286025 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:25.286468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:25.287181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:25.287638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:25.288124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:25.424472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:25.432967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d2a5455f-8bf8-40f7-b8a4-ce338bf65d4f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158746 Aug 22 19:53:25.433537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1538/3233] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:25 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:26.455693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:26.456283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:26.462942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:26.463416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:26.463877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:26.464574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:26.465047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:26.465463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:26.593677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:26.601926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-439e0805-9106-4373-88e4-6cc3f9092d12 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150665 Aug 22 19:53:26.602499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1696/3234] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:26 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:27.622949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:27.623684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:27.630760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:27.631240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:27.631698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:27.632393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:27.632839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:27.633257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:27.764727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:27.773442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8336763d-bca5-4bcc-bab4-5c4b3f9b73e5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154289 Aug 22 19:53:27.774016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1539/3235] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:27 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:28.319309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:53:28.319489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:53:28.850408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:28.851054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:28.857732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:28.858206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:28.859558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:28.859992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:28.860650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:28.861584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:28.995304 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:29.003723 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-85541be8-ab98-4007-ae08-4f1fac92cb2c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.157064 Aug 22 19:53:29.004300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1697/3236] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:28 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:29.203925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:29.204665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:29.207534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:29.216075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:29.216801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:29.217451 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:29.219138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:29.219850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:29.220504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:29.260523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:53:29.349076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb78e8fb-518d-4aee-baee-321ca20f1f91 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 204 len: 0 microversion: 2.1 time: 0.151951 Aug 22 19:53:29.349756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1540/3237] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:53:29 2022] DELETE /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:53:29.360047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:29.360644 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:29.367038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:29.367523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:29.367989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:29.368698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:29.369140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:29.369562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:29.507686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:29.516272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b3b22f05-3564-4ec3-bfe7-f104c84f79fe tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1681 microversion: 2.1 time: 0.160631 Aug 22 19:53:29.516856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1698/3238] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:29 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:30.025663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:30.026344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:30.033671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:30.034294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:30.034922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:30.036718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:30.037569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:30.038335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:30.171908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:30.180165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e17d968-8b54-4b01-9776-8d056a8affcc tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158740 Aug 22 19:53:30.180903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1541/3239] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:30 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:30.537886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:30.538502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:30.544966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:30.545448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:30.545886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:30.547085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:30.547537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:30.547990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:30.675182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:30.682815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f87f5d93-80da-4135-a07c-3e98d2bd2ccc tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1681 microversion: 2.1 time: 0.148756 Aug 22 19:53:30.683311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1699/3240] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:30 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:31.200906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:31.201756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:31.208972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:31.209735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:31.210176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:31.210889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:31.211345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:31.211800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:31.465537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:31.474753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cbe49e78-c8c1-4262-a7e4-33c68931f74d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.277670 Aug 22 19:53:31.475308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1542/3241] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:31 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:53:31.704851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:31.705545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:31.711676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:31.712362 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:31.712885 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:31.713512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:31.713966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:31.714409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:31.792175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61388384a318473e987ab06426509b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2b975d3d2d45d384b5a8dd92da782f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:31.802193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2fd2c57c-ac34-426f-aa9b-e8615c627359 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 200 len: 1613 microversion: 2.1 time: 0.101945 Aug 22 19:53:31.803007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1700/3242] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:31 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 1613 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:32.009061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-44762f0e-f506-4b99-a995-b0b0294375a7 req-8bec4de0-9bf6-44f5-9c97-4c1b26a408f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c259a0-8b0f-4898-b134-29190167c01b", "name": "network-vif-deleted", "tag": "b0ee54b2-bb05-4962-91ba-c08b65e18668"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:53:32.036538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-44762f0e-f506-4b99-a995-b0b0294375a7 req-8bec4de0-9bf6-44f5-9c97-4c1b26a408f3 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:32.037630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-44762f0e-f506-4b99-a995-b0b0294375a7 req-8bec4de0-9bf6-44f5-9c97-4c1b26a408f3 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:32.038305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-44762f0e-f506-4b99-a995-b0b0294375a7 req-8bec4de0-9bf6-44f5-9c97-4c1b26a408f3 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:32.063827 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-44762f0e-f506-4b99-a995-b0b0294375a7 req-8bec4de0-9bf6-44f5-9c97-4c1b26a408f3 service nova] Creating event network-vif-deleted:b0ee54b2-bb05-4962-91ba-c08b65e18668 for instance 47c259a0-8b0f-4898-b134-29190167c01b on hv-cinder-83538 Aug 22 19:53:32.072574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-44762f0e-f506-4b99-a995-b0b0294375a7 req-8bec4de0-9bf6-44f5-9c97-4c1b26a408f3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068857 Aug 22 19:53:32.074185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1543/3243] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:53:32.506316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:32.507217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:32.514589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:32.515199 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:32.515857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:32.517038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:32.517992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:32.519704 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:32.693621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:32.703157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0c70791d-65f1-4cc4-b592-efbf6e8afb26 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.200318 Aug 22 19:53:32.703754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1701/3244] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:32 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:32.825749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:32.826604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:32.833621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:32.834205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:32.835136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:32.835896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:32.836351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:32.836948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:32.852361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b HTTP/1.1 Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:53:32.854077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:32.856454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '47c259a0-8b0f-4898-b134-29190167c01b'} Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:32.857799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:32.861993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:32.863124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:32.863124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0823892c-d345-40d7-bdd0-4a64d8198d69 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 404 len: 111 microversion: 2.1 time: 0.034659 Aug 22 19:53:32.863124 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1544/3245] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:32 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:53:32.864619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-408df330-4ab9-4dff-b6be-249e0e542579 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '.version_select at 0x7f66df1d7ca0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:32.890749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-408df330-4ab9-4dff-b6be-249e0e542579 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794014125" status: 202 len: 0 microversion: 2.1 time: 0.028829 Aug 22 19:53:32.891828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1702/3246] 10.222.0.61 () {58 vars in 1218 bytes} [Mon Aug 22 19:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794014125 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:53:33.565180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:33.565680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:33.571695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.572188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.572631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.573329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.573784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.574212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.587890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b HTTP/1.1 Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:53:33.589466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.591274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '47c259a0-8b0f-4898-b134-29190167c01b'} Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:33.592921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.595255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.597317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:33.597317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42ee2236-9556-42d1-b482-ba2243651121 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 404 len: 111 microversion: 2.1 time: 0.030219 Aug 22 19:53:33.597317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1545/3247] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:53:33 2022] DELETE /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:53:33.601669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:33.602273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 47c259a0-8b0f-4898-b134-29190167c01b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:33.608252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.609569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.610001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.610812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.611256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.611693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.626120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b HTTP/1.1 Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:53:33.627660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.628975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '47c259a0-8b0f-4898-b134-29190167c01b'} Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:33.629728 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. Aug 22 19:53:33.630712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.631616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 47c259a0-8b0f-4898-b134-29190167c01b could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:33.631616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-194039b5-df6a-4f6d-ae97-2c7766ba2fc5 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b" status: 404 len: 111 microversion: 2.1 time: 0.031363 Aug 22 19:53:33.631616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1703/3248] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:33 2022] GET /compute/v2.1/servers/47c259a0-8b0f-4898-b134-29190167c01b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 19:53:33.637820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:33.638474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:33.644785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.645316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.645796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.646535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.647136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.647609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.661241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 HTTP/1.1 Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:53:33.662795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.664831 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '0099938f-5131-4e40-a2d6-7100e471dc41'} Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:33.666021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.667934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.669921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:33.669921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09c86abc-0982-47c2-8c88-c92207467a38 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 404 len: 111 microversion: 2.1 time: 0.030464 Aug 22 19:53:33.669921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1546/3249] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:53:33 2022] DELETE /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:53:33.673371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:33.673983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 0099938f-5131-4e40-a2d6-7100e471dc41] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:33.679953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.680424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.680859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.681542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.681993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.682429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.696528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 HTTP/1.1 Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:53:33.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.699600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '0099938f-5131-4e40-a2d6-7100e471dc41'} Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:33.700328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. Aug 22 19:53:33.701258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.702122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 0099938f-5131-4e40-a2d6-7100e471dc41 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:33.702122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f6f97ad0-0b16-40ae-89f8-91a1be886401 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41" status: 404 len: 111 microversion: 2.1 time: 0.030651 Aug 22 19:53:33.702122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1704/3250] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:33 2022] GET /compute/v2.1/servers/0099938f-5131-4e40-a2d6-7100e471dc41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 19:53:33.709981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:33.710518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:33.716481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.716966 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.717404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.718695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.719154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.719586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.725643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:33.726260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:33.732184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.732676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.733113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.733481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.733803 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.734256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.734688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa HTTP/1.1 Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:53:33.735076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.737292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa'} Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:33.737979 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.740733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.742903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:33.742903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-738b3817-0347-4d45-b655-fc16bd7b5b35 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 404 len: 111 microversion: 2.1 time: 0.030646 Aug 22 19:53:33.742903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1547/3251] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:53:33 2022] DELETE /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:53:33.747992 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:33.748611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:33.754912 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.755397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.755898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.756609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:33.757071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:33.757492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:33.771843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa HTTP/1.1 Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:53:33.773398 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.775593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa'} Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:53:33.777022 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. Aug 22 19:53:33.779090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:53:33.781393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:53:33.781393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a38df688-cafc-4781-9639-502834e35cd2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa" status: 404 len: 111 microversion: 2.1 time: 0.030656 Aug 22 19:53:33.781393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1548/3252] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:33 2022] GET /compute/v2.1/servers/8b1ae5e6-d47b-47ee-89bb-7b07feecdeaa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:53:33.876369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:33.885033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-76841238-e1bd-4372-a558-db285aeb1d7f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.163870 Aug 22 19:53:33.885605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1705/3253] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:33 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:53:34.907406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:34.908066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:34.914765 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:34.915259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:34.915732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:34.916483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:34.916941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:34.917369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:35.066985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:35.075342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82963ce0-52ba-4878-bcd7-2d65ea2d0655 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.172026 Aug 22 19:53:35.075952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1549/3254] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:34 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:36.097020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:36.097638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:36.104213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:36.104696 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:36.105124 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:36.105830 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:36.106259 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:36.106676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:36.248746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:36.257462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3c75e4aa-20a5-403e-a198-7da93383d62c tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.164384 Aug 22 19:53:36.258024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1706/3255] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:36 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:37.280291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:37.280885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:37.287406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:37.287917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:37.288353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:37.289039 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:37.289488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:37.289906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:37.418447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:37.427205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a912b1b6-7691-4cc8-af88-5539305126c5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151206 Aug 22 19:53:37.427788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1550/3256] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:37 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:38.452312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:38.453507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:38.460553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:38.461034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:38.461467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:38.462188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:38.462631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:38.463047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:38.609531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:38.617686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bf166c46-69d0-499f-9c50-b703032b0d99 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.171242 Aug 22 19:53:38.618269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1707/3257] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:38 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:39.637950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:39.638559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:39.645191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:39.645674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:39.646112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:39.646796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:39.647247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:39.647690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:39.777378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:39.785456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-59ed647e-7d90-4d46-b086-67d6d0a75471 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151375 Aug 22 19:53:39.786009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1551/3258] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:39 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:40.806245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:40.806854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:40.813308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:40.813788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:40.814226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:40.814910 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:40.815360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:40.815831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:40.939861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:40.948042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fa3c2343-47ef-45de-9c8a-f9fcc491d0f2 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.145567 Aug 22 19:53:40.948613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1708/3259] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:40 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:41.969250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:41.969889 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:41.976281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:41.976766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:41.977200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:41.977884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:41.978333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:41.978754 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:41.981402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:42.110225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:42.118456 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81590ad1-0c06-4692-b882-dd17cc3104ab tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153042 Aug 22 19:53:42.119018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1552/3260] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:41 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:43.141062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:43.141677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:43.148165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:43.148646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:43.149082 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:43.149776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:43.150225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:43.150647 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:43.282022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:43.290117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bbb75518-7310-42b1-a83f-98ab7a25b216 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153647 Aug 22 19:53:43.290702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1709/3261] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:43 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:44.311727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:44.312301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:44.318731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:44.319213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:44.319677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:44.320369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:44.320823 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:44.321359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:44.457737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:44.466241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a08c68e-7140-454f-8129-6d607a0d43ce tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158450 Aug 22 19:53:44.466805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1553/3262] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:44 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:44.635388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:53:44.635945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:53:45.487634 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:45.488261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:45.490592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:45.495745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:45.496222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:45.496651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:45.497333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:45.497774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:45.498189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:45.624458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:45.633361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b9322bfa-6c5e-4d97-8e56-a25490cb08e4 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150065 Aug 22 19:53:45.633932 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1710/3263] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:45 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:46.653463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:46.654096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:46.661286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:46.661762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:46.662196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:46.662872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:46.663321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:46.663769 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:46.789203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:46.797957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fac63aa0-416c-4fa0-8a52-1afefb1e544d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148383 Aug 22 19:53:46.798523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1554/3264] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:46 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:47.819017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:47.819671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:47.826356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:47.826832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:47.827264 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:47.828006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:47.828456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:47.828874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:47.831447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=100 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:47.957878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:47.966255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-51df3d42-6f4d-43f8-b789-fe5d0d9b16c1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151121 Aug 22 19:53:47.966820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1711/3265] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:47 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:48.987725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:48.988349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:48.994851 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:48.995333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:48.995799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:48.996500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:48.996988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:48.997376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:49.122888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:49.131663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4397a35-7d69-45ea-89cb-c53cab6a1c9a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147730 Aug 22 19:53:49.132274 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1555/3266] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:48 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:50.153352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:50.153987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:50.160994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:50.161468 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:50.161897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:50.162573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:50.163013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:50.163429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:50.297273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:50.305373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c8659300-b51f-4415-9586-fee1a0b132db tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.155847 Aug 22 19:53:50.305929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1712/3267] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:50 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:51.326171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:51.326780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:51.333868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:51.334602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:51.335033 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:51.335740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:51.336189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:51.336609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:51.468507 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:51.476709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d73a4e32-171d-4e67-aba1-1ba2e6e190c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154343 Aug 22 19:53:51.477280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1556/3268] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:51 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:52.498410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:52.499013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:52.505368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:52.505850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:52.506279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:52.506957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:52.507400 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:52.507857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:52.792097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:52.800146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1aad1dbd-658e-4cde-8767-12778628ff5d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.305561 Aug 22 19:53:52.800699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1713/3269] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:52 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:53.821088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:53.821800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:53.828139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:53.828614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:53.829046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:53.829790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:53.830236 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:53.830652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:53.959466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:53.967625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-beaa5d6c-ad50-4008-bd59-8876daca2eb6 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150405 Aug 22 19:53:53.968208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1557/3270] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:53 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:54.988482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:54.989125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:54.995725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:54.996208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:54.996643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:54.997328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:54.997776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:54.998198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:55.130574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:55.138760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e7a1277d-d336-4af7-89a4-0ae29c4d870b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154204 Aug 22 19:53:55.139320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1714/3271] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:54 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:56.159270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:56.159905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:56.166205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:56.166681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:56.167109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:56.167816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:56.168272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:56.168690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:56.298414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:56.306698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab7247ef-4891-4f8d-b2af-22e1502c584a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151246 Aug 22 19:53:56.307258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1558/3272] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:56 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:57.327223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:57.327859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:57.334476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:57.334957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:57.335393 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:57.336105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:57.336554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:57.336975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:57.465785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:57.474914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6986e7cf-3069-40e6-97fa-0b80aef9dd23 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151484 Aug 22 19:53:57.475486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1715/3273] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:57 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:58.496512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:58.497115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:58.504141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:58.504616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:58.505046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:58.505726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:58.506170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:58.506586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:58.631753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:58.639770 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbd8a706-0bfa-4324-9e47-6a0329914932 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.147078 Aug 22 19:53:58.640321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1559/3274] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:58 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:53:59.661246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:53:59.661926 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:53:59.668483 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:59.668912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:59.669351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:59.670043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:53:59.670497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:53:59.670947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:53:59.799050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:53:59.807198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-fc847aaf-e81e-4bb3-8325-70f58d0f42c8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150341 Aug 22 19:53:59.807774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1716/3275] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:53:59 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:00.828347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:00.828953 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:00.831270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:54:00.836623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:00.837100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:00.837605 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:00.838258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:00.838807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:00.839181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:00.974125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:00.982501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f21a33b7-13f6-4809-bb0b-fcd27e38d552 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.158537 Aug 22 19:54:00.983064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1560/3276] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:00 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:02.004762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:02.005371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:02.011429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:02.011941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:02.012383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:02.013071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:02.013521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:02.013946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:02.144390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:02.152664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-627caf44-9ac3-4ab0-8aaa-a66cb6f7fa93 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152355 Aug 22 19:54:02.153200 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1717/3277] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:01 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:03.173547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:03.174761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:03.181455 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:03.181936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:03.182372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:03.183062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:03.183513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:03.183969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:03.549119 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:03.557641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f40f3531-a70f-46cf-9162-a3c1a6a6c8a5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.387943 Aug 22 19:54:03.558206 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1561/3278] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:03 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:04.578295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:04.578900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:04.586151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:04.586633 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:04.587061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:04.587769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:04.588238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:04.588656 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:04.717845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:04.726774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a05a7974-3c8c-4878-94e3-cb0a7aa2d24b tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152324 Aug 22 19:54:04.727336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1718/3279] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:04 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:05.749826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:05.750467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:05.757553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:05.758031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:05.758462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:05.759142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:05.759590 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:05.760031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:05.888468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:05.896571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bdddc41-516a-46dc-ac19-a9e4b659b886 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.151165 Aug 22 19:54:05.897132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1562/3280] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:05 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:06.916531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:06.917144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:06.923477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:06.923988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:06.924418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:06.925094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:06.925542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:06.925956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:07.058185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:07.066780 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ffb107f7-f56e-4920-b6d3-68a2cf79ad73 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.154166 Aug 22 19:54:07.067332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1719/3281] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:06 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:08.088079 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:08.088712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:08.095099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:08.095592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:08.096077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:08.096742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:08.097196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:08.097622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:08.228399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:08.237059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3ba4391e-864c-4123-8ad3-fe3b55fb5c13 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.152655 Aug 22 19:54:08.237658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1563/3282] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:08 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:09.258432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:09.259060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:09.265467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:09.265939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:09.266366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:09.267045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:09.267489 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:09.268524 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:09.397068 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:09.405538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4dcf27c7-b68c-43d3-aa43-844bc983ec6f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150947 Aug 22 19:54:09.406101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1720/3283] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:09 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:10.426536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:10.427300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:10.433691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:10.434167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:10.434599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:10.435278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:10.435750 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:10.436170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:10.563951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:10.572562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b437ad4c-8e8e-4d5d-a4ed-1a03443d8606 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.150084 Aug 22 19:54:10.573121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1564/3284] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:10 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:11.597612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:11.598405 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:11.605147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:11.605632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:11.606064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:11.607341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:11.607828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:11.608731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:11.744552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:11.753439 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-681207a6-156c-47b9-85c1-4056ae875aa8 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.161211 Aug 22 19:54:11.754008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1721/3285] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:11 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:12.774914 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:12.775693 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:12.782356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:12.782834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:12.783951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:12.784657 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:12.785108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:12.785530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:12.789583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=78 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:54:12.931875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:12.940588 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dcee4b44-8209-4bf6-864b-0be6eca1ce16 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.169647 Aug 22 19:54:12.941162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1565/3286] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:12 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:13.961726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:13.962369 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:13.968811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:13.969866 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:13.970306 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:13.971049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:13.971506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:13.971963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:14.102601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:14.110770 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1295b6f0-87e2-4db9-b59a-845dd9f157a7 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.153145 Aug 22 19:54:14.111858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1722/3287] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:13 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:15.140307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:15.140960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:15.147714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:15.148203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:15.148639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:15.149374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:15.149828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:15.150259 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:15.277678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:15.286249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e44674ef-6b6f-457f-b14f-8313121abe47 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.149824 Aug 22 19:54:15.286809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1566/3288] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:15 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:16.307121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:16.307668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:16.309918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=26 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:54:16.315285 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:16.316420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:16.317020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:16.317716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:16.318165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:16.318584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:16.443282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:16.451893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-01fb1ce6-44c9-479d-8d77-9f0ca2db2cfa tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.148647 Aug 22 19:54:16.452453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1723/3289] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:16 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:17.473193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:17.473809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: f6744e43-5389-4422-9030-dfdf1b522dcc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:54:17.482136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:17.482981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:17.483186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:17.484087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:17.484592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:17.485258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:17.620087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:54:17.628431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e22a0ab7-ba0d-4727-9931-484d80fd4ebb tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc" status: 200 len: 1736 microversion: 2.1 time: 0.159254 Aug 22 19:54:17.629002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1567/3290] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:54:17 2022] GET /compute/v2.1/servers/f6744e43-5389-4422-9030-dfdf1b522dcc => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:54:17.648715 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ee2c9016-4fa1-43ea-a4b2-19a14b364d3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '.version_select at 0x7f66df27dca0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:54:17.667941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ee2c9016-4fa1-43ea-a4b2-19a14b364d3a tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297287508" status: 202 len: 0 microversion: 2.1 time: 0.023041 Aug 22 19:54:17.668510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1724/3291] 10.222.0.61 () {58 vars in 1221 bytes} [Mon Aug 22 19:54:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1297287508 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:54:18.578464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d7a2d448-e150-443a-9930-aeb2d19420eb req-2147396d-bf06-4837-83ca-667cfa35b539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6744e43-5389-4422-9030-dfdf1b522dcc", "tag": "bec8e930-d13a-4c77-9943-50527898de38"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:54:18.588600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d7a2d448-e150-443a-9930-aeb2d19420eb req-2147396d-bf06-4837-83ca-667cfa35b539 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:54:18.589075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d7a2d448-e150-443a-9930-aeb2d19420eb req-2147396d-bf06-4837-83ca-667cfa35b539 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:54:18.589509 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d7a2d448-e150-443a-9930-aeb2d19420eb req-2147396d-bf06-4837-83ca-667cfa35b539 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:54:18.601383 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d7a2d448-e150-443a-9930-aeb2d19420eb req-2147396d-bf06-4837-83ca-667cfa35b539 service nova] Creating event network-changed:bec8e930-d13a-4c77-9943-50527898de38 for instance f6744e43-5389-4422-9030-dfdf1b522dcc on hv-cinder-83538 Aug 22 19:54:18.608083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d7a2d448-e150-443a-9930-aeb2d19420eb req-2147396d-bf06-4837-83ca-667cfa35b539 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032748 Aug 22 19:54:18.609335 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1568/3292] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:55:44.838622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=77 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:44.839551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:44.843740 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:44.844328 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:55:44.852217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:55:44.852702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:55:44.853145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:55:44.853843 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:55:44.854296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:55:44.854746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:55:44.868690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] HTTP exception thrown: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Request method failure captured: Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 HTTP/1.1 Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aA9Ay6GWGQ0MVne0HlegmkVSvIeLGXdreDrlApfgpwRhocJOM5UI2pZQI8_zlvhmXcYz3rLSSIwjlXfDzvwq932K5Sty2YrJQqSgwIa6euu5R3KtOd2_1BADojkUjj7kE5tE1V5bg3I7A60IG3OWpFQR3DrSJiTfUYSKlMTas2ReA Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: ca75caa807b445f486899173277b5051 Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:55:44.870558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ca75caa807b445f486899173277b5051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ca75caa807b445f486899173277b5051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}] Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: ca75caa807b445f486899173277b5051 Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 21d0ab6d1a724547b8c643287df897da Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.871737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '604c6a93-ddc1-4f33-81a5-f431e35b16a8'} Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:55:44.872388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.873525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.875395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Returning 404 to user: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:55:44.876422 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c2771b5a-09ca-42bb-8af4-30dcf3756f8a tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "DELETE /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 404 len: 111 microversion: 2.1 time: 0.039739 Aug 22 19:55:44.877140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1725/3293] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:55:44 2022] DELETE /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 19:55:44.884362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=17 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:44.885151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=19 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:44.890131 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:44.890859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] [instance: 604c6a93-ddc1-4f33-81a5-f431e35b16a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:55:44.898494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:55:44.898982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:55:44.899416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:55:44.900133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:55:44.900582 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:55:44.900999 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:55:44.916133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] HTTP exception thrown: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Request method failure captured: Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 HTTP/1.1 Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aA9Ay6GWGQ0MVne0HlegmkVSvIeLGXdreDrlApfgpwRhocJOM5UI2pZQI8_zlvhmXcYz3rLSSIwjlXfDzvwq932K5Sty2YrJQqSgwIa6euu5R3KtOd2_1BADojkUjj7kE5tE1V5bg3I7A60IG3OWpFQR3DrSJiTfUYSKlMTas2ReA Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: ca75caa807b445f486899173277b5051 Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:55:44.917490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ca75caa807b445f486899173277b5051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ca75caa807b445f486899173277b5051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ca75caa807b445f486899173277b5051"}]}] Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ca75caa807b445f486899173277b5051 Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476597328 Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 21d0ab6d1a724547b8c643287df897da Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-476597328-project Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.918608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '604c6a93-ddc1-4f33-81a5-f431e35b16a8'} Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:55:44.919240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. Aug 22 19:55:44.920247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:44.921158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] Returning 404 to user: Instance 604c6a93-ddc1-4f33-81a5-f431e35b16a8 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:55:44.921158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-06abab96-eec1-41fb-9569-863de1e1c7cf tempest-AttachVolumeTestJSON-476597328 tempest-AttachVolumeTestJSON-476597328-project] 10.222.0.61 "GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8" status: 404 len: 111 microversion: 2.1 time: 0.037045 Aug 22 19:55:44.921158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1569/3294] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:55:44 2022] GET /compute/v2.1/servers/604c6a93-ddc1-4f33-81a5-f431e35b16a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:55:47.282085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-7c8f2580-ce5e-49ea-a53b-a2f6ee63b2cd req-ff42dcdd-1616-428c-964b-50976a4340cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9698a0b1-a98a-40e1-9093-39946273a155", "name": "network-vif-deleted", "tag": "23337ac5-214c-419d-b22b-ad62bd9b3776"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:55:47.296412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-7c8f2580-ce5e-49ea-a53b-a2f6ee63b2cd req-ff42dcdd-1616-428c-964b-50976a4340cc service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:55:47.296913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-7c8f2580-ce5e-49ea-a53b-a2f6ee63b2cd req-ff42dcdd-1616-428c-964b-50976a4340cc service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:55:47.297497 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-7c8f2580-ce5e-49ea-a53b-a2f6ee63b2cd req-ff42dcdd-1616-428c-964b-50976a4340cc service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:55:47.316406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-7c8f2580-ce5e-49ea-a53b-a2f6ee63b2cd req-ff42dcdd-1616-428c-964b-50976a4340cc service nova] Creating event network-vif-deleted:23337ac5-214c-419d-b22b-ad62bd9b3776 for instance 9698a0b1-a98a-40e1-9093-39946273a155 on hv-cinder-83538 Aug 22 19:55:47.325629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-7c8f2580-ce5e-49ea-a53b-a2f6ee63b2cd req-ff42dcdd-1616-428c-964b-50976a4340cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204694 Aug 22 19:55:47.326748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1726/3295] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:55:49.379707 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-c3a3a751-ac82-4a5c-8f0c-d20f7840c054 req-e5f279db-ef51-4d4a-b640-6f8230cc36a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6744e43-5389-4422-9030-dfdf1b522dcc", "name": "network-vif-deleted", "tag": "bec8e930-d13a-4c77-9943-50527898de38"}, {"server_uuid": "0b81f37d-80e6-429a-9afd-79fccb869bde", "name": "network-vif-deleted", "tag": "2a89284f-51ed-4cd5-9e85-4de6ce81e9ac"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:55:49.401804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c3a3a751-ac82-4a5c-8f0c-d20f7840c054 req-e5f279db-ef51-4d4a-b640-6f8230cc36a7 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:55:49.404404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c3a3a751-ac82-4a5c-8f0c-d20f7840c054 req-e5f279db-ef51-4d4a-b640-6f8230cc36a7 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:55:49.405009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-c3a3a751-ac82-4a5c-8f0c-d20f7840c054 req-e5f279db-ef51-4d4a-b640-6f8230cc36a7 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:55:49.431015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c3a3a751-ac82-4a5c-8f0c-d20f7840c054 req-e5f279db-ef51-4d4a-b640-6f8230cc36a7 service nova] Creating event network-vif-deleted:bec8e930-d13a-4c77-9943-50527898de38 for instance f6744e43-5389-4422-9030-dfdf1b522dcc on hv-cinder-83538 Aug 22 19:55:49.432231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-c3a3a751-ac82-4a5c-8f0c-d20f7840c054 req-e5f279db-ef51-4d4a-b640-6f8230cc36a7 service nova] Creating event network-vif-deleted:2a89284f-51ed-4cd5-9e85-4de6ce81e9ac for instance 0b81f37d-80e6-429a-9afd-79fccb869bde on hv-cinder-83538 Aug 22 19:55:49.448207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-c3a3a751-ac82-4a5c-8f0c-d20f7840c054 req-e5f279db-ef51-4d4a-b640-6f8230cc36a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073570 Aug 22 19:55:49.453369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1570/3296] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:55:50.671568 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7f590f59-9ad4-4303-b694-136537595f20 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] Action: 'create', calling method: .version_select at 0x7f66df1d70d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-350837309", "metadata": {"Type": "work"}}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:55:50.970223 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7f590f59-9ad4-4303-b694-136537595f20 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.412705 Aug 22 19:55:50.970877 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1727/3297] 10.222.0.61 () {60 vars in 1156 bytes} [Mon Aug 22 19:55:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 414 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 19:55:50.984614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55d008e7-de39-4148-8d90-b3fd82eee7e2 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] Calling method '.version_select at 0x7f66e7f903a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:51.033057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55d008e7-de39-4148-8d90-b3fd82eee7e2 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3" status: 200 len: 352 microversion: 2.1 time: 0.053018 Aug 22 19:55:51.033642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1571/3298] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:55:50 2022] GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:55:52.049148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-855e3f7b-8004-4e6a-bd4a-ee8ee1152651 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] Calling method '.version_select at 0x7f66e42544c0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:52.100718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-855e3f7b-8004-4e6a-bd4a-ee8ee1152651 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3" status: 200 len: 353 microversion: 2.1 time: 0.055333 Aug 22 19:55:52.101281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1728/3299] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:55:52 2022] GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:55:52.113724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d993a487-c5af-4f5d-bfe6-b7edf891709b tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] Calling method '.version_select at 0x7f66e4098040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:52.166998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d993a487-c5af-4f5d-bfe6-b7edf891709b tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3" status: 200 len: 353 microversion: 2.1 time: 0.057528 Aug 22 19:55:52.167692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1572/3300] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:55:52 2022] GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:55:52.180914 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-758bf7a6-9746-4222-9e0b-34f405241fef tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] Calling method '.version_select at 0x7f66e43baee0>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:52.241118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-758bf7a6-9746-4222-9e0b-34f405241fef tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3" status: 202 len: 0 microversion: 2.1 time: 0.064495 Aug 22 19:55:52.241683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1729/3301] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:55:52 2022] DELETE /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 19:55:52.250004 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b4d579c-181a-41ab-94e5-ce648c2d3db3 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] Calling method '.version_select at 0x7f66e7f5c430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:52.297907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b4d579c-181a-41ab-94e5-ce648c2d3db3 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3" status: 200 len: 352 microversion: 2.1 time: 0.052000 Aug 22 19:55:52.298471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1573/3302] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:55:52 2022] GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:55:53.311460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-218133fb-a93c-43d3-9aa9-59e2134ff5e7 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] Calling method '.version_select at 0x7f66df27d820>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:53.339893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-218133fb-a93c-43d3-9aa9-59e2134ff5e7 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] HTTP exception thrown: Volume 3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 could not be found. Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-218133fb-a93c-43d3-9aa9-59e2134ff5e7 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] Request method failure captured: Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 HTTP/1.1 Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA99Goi2hmUUmPuAs3law7mD7JB_wlm5BdcsHQHbf81eyANWAxIR9bxnWDoBTW9h2ouzO7Dt-lCEQB1SLLG9_nmoAa6Xk5bQpXrYZ9X5n6lKlLG1WKJYFXAJycG8RlBiINSz6zmGKtmzdaQXQfoaUDEKYNJ-CHGMcxSl7Z-5y4JnHQxs Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: ed77f65b9c474e3288f3e83cf54d5e5f Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesGetTestJSON-1785862446 Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:55:53.341755 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed77f65b9c474e3288f3e83cf54d5e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed77f65b9c474e3288f3e83cf54d5e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed77f65b9c474e3288f3e83cf54d5e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed77f65b9c474e3288f3e83cf54d5e5f"}]}] Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesGetTestJSON-1785862446 Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: ed77f65b9c474e3288f3e83cf54d5e5f Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesGetTestJSON-1785862446 Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesGetTestJSON-1785862446-project Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 1c37c248654a417191ced0acb2d767ad Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesGetTestJSON-1785862446-project Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Volume 3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 could not be found. Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3'} Aug 22 19:55:53.343621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 could not be found. (HTTP 404) (Request-ID: req-8a5726a5-1719-4d56-863d-1a4e8b1703ef) Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:53.344498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:55:53.345781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 could not be found. Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 19:55:53.346735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 could not be found. Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 could not be found. Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-218133fb-a93c-43d3-9aa9-59e2134ff5e7 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] Returning 404 to user: Volume 3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-218133fb-a93c-43d3-9aa9-59e2134ff5e7 tempest-VolumesGetTestJSON-1785862446 tempest-VolumesGetTestJSON-1785862446-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3" status: 404 len: 109 microversion: 2.1 time: 0.035997 Aug 22 19:55:53.347800 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1730/3303] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:55:53 2022] GET /compute/v2.1/os-volumes/3057623c-ad1b-4ba7-8ac8-3ccd3e69cef3 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:55:54.810896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f85e25a4-ab5f-45aa-9dae-a07f288b3ad5 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Action: 'create', calling method: .version_select at 0x7f66e7f90d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-658301875", "metadata": {"Type": "work"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f85e25a4-ab5f-45aa-9dae-a07f288b3ad5 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Request method failure captured: Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 121 Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA99KmR5DQMd2n-4Jwuloty82OsQJAwCS90cbDHj2gNkmvtIBT-gotFmSm4sKQ6WPeOLvcqVrPeZ1Ius0Cf2RjmRVGEGZrWduQ4yeZzTFE5plXzMIOUHRzzvvk5FXF3Jv43l6tVqm_ncfuvLIgb1_cQ46gOnYxLl5mqxURS-hVpv8Y_M Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:55:54.820659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}] Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 0e24963c0982447babdc41a6bdc4cb0b Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-658301875", "metadata": {"Type": "work"}}} Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: Aug 22 19:55:54.822512 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-658301875', 'metadata': {'Type': 'work'}}}} Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi '#$%' Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:55:54.823677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 19:55:54.825178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 19:55:54.826283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 19:55:54.826283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.826283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f85e25a4-ab5f-45aa-9dae-a07f288b3ad5 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:55:54.826283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f85e25a4-ab5f-45aa-9dae-a07f288b3ad5 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.124580 Aug 22 19:55:54.826283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1574/3304] 10.222.0.61 () {60 vars in 1156 bytes} [Mon Aug 22 19:55:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:55:54.835307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1271d62e-6bb4-41a2-bc84-6e02b91785af tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Action: 'create', calling method: .version_select at 0x7f66e4284670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-887726806", "metadata": {"Type": "work"}}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1271d62e-6bb4-41a2-bc84-6e02b91785af tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Request method failure captured: Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 119 Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA99KmR5DQMd2n-4Jwuloty82OsQJAwCS90cbDHj2gNkmvtIBT-gotFmSm4sKQ6WPeOLvcqVrPeZ1Ius0Cf2RjmRVGEGZrWduQ4yeZzTFE5plXzMIOUHRzzvvk5FXF3Jv43l6tVqm_ncfuvLIgb1_cQ46gOnYxLl5mqxURS-hVpv8Y_M Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:55:54.839767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}] Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 0e24963c0982447babdc41a6bdc4cb0b Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-887726806", "metadata": {"Type": "work"}}} Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: Aug 22 19:55:54.841125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-887726806', 'metadata': {'Type': 'work'}}}} Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise error Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi '0' Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:55:54.841965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 19:55:54.843349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 19:55:54.844530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 19:55:54.844530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.844530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1271d62e-6bb4-41a2-bc84-6e02b91785af tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:55:54.844530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1271d62e-6bb4-41a2-bc84-6e02b91785af tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011348 Aug 22 19:55:54.844530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1731/3305] 10.222.0.61 () {60 vars in 1156 bytes} [Mon Aug 22 19:55:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:55:54.850527 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab9dbf37-a6c2-41c4-8bb8-0b54f87ee0cc tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Action: 'create', calling method: .version_select at 0x7f66e7f5cc10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-682308108", "metadata": {"Type": "work"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab9dbf37-a6c2-41c4-8bb8-0b54f87ee0cc tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Request method failure captured: Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 118 Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA99KmR5DQMd2n-4Jwuloty82OsQJAwCS90cbDHj2gNkmvtIBT-gotFmSm4sKQ6WPeOLvcqVrPeZ1Ius0Cf2RjmRVGEGZrWduQ4yeZzTFE5plXzMIOUHRzzvvk5FXF3Jv43l6tVqm_ncfuvLIgb1_cQ46gOnYxLl5mqxURS-hVpv8Y_M Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:55:54.854733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}] Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 0e24963c0982447babdc41a6bdc4cb0b Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-682308108", "metadata": {"Type": "work"}}} Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: Aug 22 19:55:54.856117 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-682308108', 'metadata': {'Type': 'work'}}}} Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi '' Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:55:54.856891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 19:55:54.858176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 19:55:54.859237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 19:55:54.859237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.859237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab9dbf37-a6c2-41c4-8bb8-0b54f87ee0cc tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:55:54.859237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab9dbf37-a6c2-41c4-8bb8-0b54f87ee0cc tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009368 Aug 22 19:55:54.859237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1575/3306] 10.222.0.61 () {60 vars in 1156 bytes} [Mon Aug 22 19:55:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 19:55:54.864737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e5a0e84b-3592-400f-849e-e88819042242 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Calling method '.version_select at 0x7f66e7e45d30>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:54.893872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-e5a0e84b-3592-400f-849e-e88819042242 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] HTTP exception thrown: Volume tempest-invalid-706243176 could not be found. Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e5a0e84b-3592-400f-849e-e88819042242 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Request method failure captured: Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-706243176 HTTP/1.1 Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA99KmR5DQMd2n-4Jwuloty82OsQJAwCS90cbDHj2gNkmvtIBT-gotFmSm4sKQ6WPeOLvcqVrPeZ1Ius0Cf2RjmRVGEGZrWduQ4yeZzTFE5plXzMIOUHRzzvvk5FXF3Jv43l6tVqm_ncfuvLIgb1_cQ46gOnYxLl5mqxURS-hVpv8Y_M Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:55:54.895840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}] Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 0e24963c0982447babdc41a6bdc4cb0b Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Volume tempest-invalid-706243176 could not be found. Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': 'tempest-invalid-706243176'} Aug 22 19:55:54.897205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-706243176 could not be found. (HTTP 404) (Request-ID: req-9b8d1cef-43f4-4323-854c-a2551e95403c) Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.898031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 19:55:54.899084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-706243176 could not be found. Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:55:54.900268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-706243176 could not be found. Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-706243176 could not be found. Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e5a0e84b-3592-400f-849e-e88819042242 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Returning 404 to user: Volume tempest-invalid-706243176 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e5a0e84b-3592-400f-849e-e88819042242 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-706243176" status: 404 len: 98 microversion: 2.1 time: 0.036164 Aug 22 19:55:54.901319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1732/3307] 10.222.0.61 () {58 vars in 1215 bytes} [Mon Aug 22 19:55:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-706243176 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 19:55:54.906962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42171d97-d3ac-4135-9f1f-506c39c6c01a tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003906 Aug 22 19:55:54.907457 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1576/3308] 10.222.0.61 () {58 vars in 1140 bytes} [Mon Aug 22 19:55:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 19:55:54.916188 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-750f6665-5e76-4840-9d53-cb0470ce9c4f tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004576 Aug 22 19:55:54.916667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1733/3309] 10.222.0.61 () {58 vars in 1137 bytes} [Mon Aug 22 19:55:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 19:55:54.924970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb8a3d10-d230-402a-9fe2-b7b8c6cb49ff tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Calling method '.version_select at 0x7f66e7f90700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:54.953489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-fb8a3d10-d230-402a-9fe2-b7b8c6cb49ff tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] HTTP exception thrown: Volume 4fd72316-f7f5-48b7-b872-86e84e620577 could not be found. Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb8a3d10-d230-402a-9fe2-b7b8c6cb49ff tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Request method failure captured: Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-volumes/4fd72316-f7f5-48b7-b872-86e84e620577 HTTP/1.1 Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA99KmR5DQMd2n-4Jwuloty82OsQJAwCS90cbDHj2gNkmvtIBT-gotFmSm4sKQ6WPeOLvcqVrPeZ1Ius0Cf2RjmRVGEGZrWduQ4yeZzTFE5plXzMIOUHRzzvvk5FXF3Jv43l6tVqm_ncfuvLIgb1_cQ46gOnYxLl5mqxURS-hVpv8Y_M Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 19:55:54.955406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}] Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 0e24963c0982447babdc41a6bdc4cb0b Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Volume 4fd72316-f7f5-48b7-b872-86e84e620577 could not be found. Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '4fd72316-f7f5-48b7-b872-86e84e620577'} Aug 22 19:55:54.956828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4fd72316-f7f5-48b7-b872-86e84e620577 could not be found. (HTTP 404) (Request-ID: req-99e6ded7-3cfb-487e-a4b4-cb8f238398a2) Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.957617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 19:55:54.959133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4fd72316-f7f5-48b7-b872-86e84e620577 could not be found. Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 19:55:54.960481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4fd72316-f7f5-48b7-b872-86e84e620577 could not be found. Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4fd72316-f7f5-48b7-b872-86e84e620577 could not be found. Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb8a3d10-d230-402a-9fe2-b7b8c6cb49ff tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Returning 404 to user: Volume 4fd72316-f7f5-48b7-b872-86e84e620577 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb8a3d10-d230-402a-9fe2-b7b8c6cb49ff tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/4fd72316-f7f5-48b7-b872-86e84e620577" status: 404 len: 109 microversion: 2.1 time: 0.035585 Aug 22 19:55:54.961627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1577/3310] 10.222.0.61 () {58 vars in 1248 bytes} [Mon Aug 22 19:55:54 2022] DELETE /compute/v2.1/os-volumes/4fd72316-f7f5-48b7-b872-86e84e620577 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:55:54.966462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-df6fc454-5fd3-4048-b65f-6bc414e39f56 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Calling method '.version_select at 0x7f66e7e45430>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:55:54.993484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-df6fc454-5fd3-4048-b65f-6bc414e39f56 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] HTTP exception thrown: Volume 77bbe86a-203f-453b-952d-9fab64aa3bc9 could not be found. Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-df6fc454-5fd3-4048-b65f-6bc414e39f56 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Request method failure captured: Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/os-volumes/77bbe86a-203f-453b-952d-9fab64aa3bc9 HTTP/1.1 Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA99KmR5DQMd2n-4Jwuloty82OsQJAwCS90cbDHj2gNkmvtIBT-gotFmSm4sKQ6WPeOLvcqVrPeZ1Ius0Cf2RjmRVGEGZrWduQ4yeZzTFE5plXzMIOUHRzzvvk5FXF3Jv43l6tVqm_ncfuvLIgb1_cQ46gOnYxLl5mqxURS-hVpv8Y_M Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:55:54.995411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2346c9f539ad4a9882738574eeda51bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2346c9f539ad4a9882738574eeda51bf"}]}] Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 2346c9f539ad4a9882738574eeda51bf Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesNegativeTest-163111277 Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 0e24963c0982447babdc41a6bdc4cb0b Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesNegativeTest-163111277-project Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Volume 77bbe86a-203f-453b-952d-9fab64aa3bc9 could not be found. Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '77bbe86a-203f-453b-952d-9fab64aa3bc9'} Aug 22 19:55:54.996793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77bbe86a-203f-453b-952d-9fab64aa3bc9 could not be found. (HTTP 404) (Request-ID: req-af0384c3-c61c-487d-9718-a029db3b9ab6) Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.997698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 19:55:54.998930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77bbe86a-203f-453b-952d-9fab64aa3bc9 could not be found. Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 19:55:54.999897 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77bbe86a-203f-453b-952d-9fab64aa3bc9 could not be found. Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77bbe86a-203f-453b-952d-9fab64aa3bc9 could not be found. Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-df6fc454-5fd3-4048-b65f-6bc414e39f56 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] Returning 404 to user: Volume 77bbe86a-203f-453b-952d-9fab64aa3bc9 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-df6fc454-5fd3-4048-b65f-6bc414e39f56 tempest-VolumesNegativeTest-163111277 tempest-VolumesNegativeTest-163111277-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/77bbe86a-203f-453b-952d-9fab64aa3bc9" status: 404 len: 109 microversion: 2.1 time: 0.034142 Aug 22 19:55:55.000823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1734/3311] 10.222.0.61 () {58 vars in 1245 bytes} [Mon Aug 22 19:55:54 2022] GET /compute/v2.1/os-volumes/77bbe86a-203f-453b-952d-9fab64aa3bc9 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:56:29.768576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:56:29.769322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:56:29.773564 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1963590874", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "networks": [{"uuid": "9a0c4efa-e548-4a11-88e8-875e52cd4c37"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:56:29.826411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] validate_networks() for [('9a0c4efa-e548-4a11-88e8-875e52cd4c37', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:56:30.243775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:56:30.244252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:56:30.244719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:56:30.245133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:56:30.245552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:56:30.254907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:30.255392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:30.255879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:30.256611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:30.257066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:30.257494 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:30.274490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Getting quotas for project 532a20c016764748a97e11413dab4aba. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:56:30.278462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Getting quotas for user 8c727c852d63447d89179e17d4731628 and project 532a20c016764748a97e11413dab4aba. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:56:30.289380 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:56:30.291821 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:56:30.337470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [f0868bff-bac2-4fb8-8114-6f6a279b604e] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 19:56:31.344547 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [f0868bff-bac2-4fb8-8114-6f6a279b604e] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 49196. Aug 22 19:56:31.348708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9afde36d-a11e-47ad-8c3b-50359b26825f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584177 Aug 22 19:56:31.349353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1578/3312] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:56:31.357542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:56:31.358294 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:56:31.364076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c1f31ccf-9c20-41a4-8b20-3402369db9bf tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:31.364809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c1f31ccf-9c20-41a4-8b20-3402369db9bf tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:31.419376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c1f31ccf-9c20-41a4-8b20-3402369db9bf tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:31.426220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c1f31ccf-9c20-41a4-8b20-3402369db9bf tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1214 microversion: 2.1 time: 0.070144 Aug 22 19:56:31.426793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1735/3313] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:31 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:32.447303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6ba6d895-f190-405c-9a16-7ed7c90d76f9 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:32.448626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6ba6d895-f190-405c-9a16-7ed7c90d76f9 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:32.507551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6ba6d895-f190-405c-9a16-7ed7c90d76f9 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:32.515251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6ba6d895-f190-405c-9a16-7ed7c90d76f9 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1214 microversion: 2.1 time: 0.072422 Aug 22 19:56:32.515920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1579/3314] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:32 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:33.535707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f4a73e23-3156-47b6-868c-75e62ef91ff3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:33.536387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f4a73e23-3156-47b6-868c-75e62ef91ff3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:33.588235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f4a73e23-3156-47b6-868c-75e62ef91ff3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:33.595066 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f4a73e23-3156-47b6-868c-75e62ef91ff3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1214 microversion: 2.1 time: 0.063206 Aug 22 19:56:33.595628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1736/3315] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:33 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:34.615930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9ea25e9-ca40-4752-8b4f-eec41d141df8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:34.616537 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9ea25e9-ca40-4752-8b4f-eec41d141df8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:34.668922 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9ea25e9-ca40-4752-8b4f-eec41d141df8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:34.675756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9ea25e9-ca40-4752-8b4f-eec41d141df8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1214 microversion: 2.1 time: 0.063600 Aug 22 19:56:34.676316 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1580/3316] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:34 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:35.696732 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:35.697374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:35.705125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:35.705608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:35.706041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:35.706726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:35.707179 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:35.707880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:35.768297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:35.775939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7e9fdd38-e744-46b5-a707-83ae3a3872fc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1218 microversion: 2.1 time: 0.083076 Aug 22 19:56:35.776493 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1737/3317] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:35 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:36.797021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:36.797637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:36.804879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:36.805367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:36.805808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:36.806503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:36.806963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:36.807390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:36.883354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:36.892421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-192b67b4-a3ab-4331-a3bb-72e03ace0697 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1272 microversion: 2.1 time: 0.099318 Aug 22 19:56:36.893045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1581/3318] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:36 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:37.813026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-0aea0d18-4219-419d-8756-14aa599fe7a3 req-5f68e29a-b2b6-4e5a-84db-13813b8d3dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde18609-3401-446f-bec0-c386ad625f4d", "tag": "80750e1d-770d-4805-8599-bab3ab60fd03"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:56:37.824429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-0aea0d18-4219-419d-8756-14aa599fe7a3 req-5f68e29a-b2b6-4e5a-84db-13813b8d3dcc service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:37.824952 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-0aea0d18-4219-419d-8756-14aa599fe7a3 req-5f68e29a-b2b6-4e5a-84db-13813b8d3dcc service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:37.825789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-0aea0d18-4219-419d-8756-14aa599fe7a3 req-5f68e29a-b2b6-4e5a-84db-13813b8d3dcc service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:37.837435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-0aea0d18-4219-419d-8756-14aa599fe7a3 req-5f68e29a-b2b6-4e5a-84db-13813b8d3dcc service nova] Creating event network-changed:80750e1d-770d-4805-8599-bab3ab60fd03 for instance bde18609-3401-446f-bec0-c386ad625f4d on hv-cinder-83538 Aug 22 19:56:37.842968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-0aea0d18-4219-419d-8756-14aa599fe7a3 req-5f68e29a-b2b6-4e5a-84db-13813b8d3dcc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033607 Aug 22 19:56:37.843562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1738/3319] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:56:37.913601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:37.914200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:37.920972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:37.921607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:37.922195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:37.922925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:37.923392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:37.923855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:38.399324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:38.409977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef013358-af8b-48fa-8777-9630b0c2c12a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1314 microversion: 2.1 time: 0.500243 Aug 22 19:56:38.410567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1582/3320] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:37 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:39.433190 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:39.433929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:39.440733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:39.441220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:39.441659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:39.442410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:39.442870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:39.443296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:39.795720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:39.803416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c9bf72fd-1caa-4db5-b124-05c1c791fed3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1314 microversion: 2.1 time: 0.374900 Aug 22 19:56:39.804001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1739/3321] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:39 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:40.824718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:40.825372 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:40.827664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:56:40.833850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:40.834329 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:40.834762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:40.835450 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:40.835928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:40.836348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:40.969226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:40.976988 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eec23515-e6ab-4256-8488-86ec57ac44a3 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1314 microversion: 2.1 time: 0.156305 Aug 22 19:56:40.977551 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1583/3322] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:40 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:41.998371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:41.998980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:42.005587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:42.006069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:42.006501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:42.007185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:42.007637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:42.008077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:42.134289 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:42.142717 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d112a535-82b8-440e-920a-332ca629a5a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1314 microversion: 2.1 time: 0.148592 Aug 22 19:56:42.143505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1740/3323] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:41 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:43.162312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:43.162929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:43.169320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:43.169799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:43.170237 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:43.170925 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:43.171376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:43.171834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:43.304518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:43.312510 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa10e61c-c23a-40bd-b60c-6ca8dcdb4733 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1314 microversion: 2.1 time: 0.154067 Aug 22 19:56:43.313077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1584/3324] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:43 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:44.333431 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:44.334042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:44.336496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:56:44.342655 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:44.343133 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:44.343565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:44.344281 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:44.344730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:44.345153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:44.475588 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:44.483587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5ddc2390-caf0-4afe-94e3-585d9baafcbc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1314 microversion: 2.1 time: 0.154312 Aug 22 19:56:44.484171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1741/3325] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:44 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:44.970285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:56:44.970860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 19:56:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:56:45.020006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:56:45.150165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-133912e8-4bf3-47d4-8ea6-2f62df2ac2d4 req-464f56ca-74db-47c7-b407-ff8ea98d80a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde18609-3401-446f-bec0-c386ad625f4d", "name": "network-vif-plugged", "status": "completed", "tag": "80750e1d-770d-4805-8599-bab3ab60fd03"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:56:45.160088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-133912e8-4bf3-47d4-8ea6-2f62df2ac2d4 req-464f56ca-74db-47c7-b407-ff8ea98d80a9 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:45.160552 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-133912e8-4bf3-47d4-8ea6-2f62df2ac2d4 req-464f56ca-74db-47c7-b407-ff8ea98d80a9 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:45.160973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-133912e8-4bf3-47d4-8ea6-2f62df2ac2d4 req-464f56ca-74db-47c7-b407-ff8ea98d80a9 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:45.171487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-133912e8-4bf3-47d4-8ea6-2f62df2ac2d4 req-464f56ca-74db-47c7-b407-ff8ea98d80a9 service nova] Creating event network-vif-plugged:80750e1d-770d-4805-8599-bab3ab60fd03 for instance bde18609-3401-446f-bec0-c386ad625f4d on hv-cinder-83538 Aug 22 19:56:45.177127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-133912e8-4bf3-47d4-8ea6-2f62df2ac2d4 req-464f56ca-74db-47c7-b407-ff8ea98d80a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162251 Aug 22 19:56:45.177698 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1585/3326] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:56:45.504481 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:45.505089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:45.511898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:45.512377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:45.512811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:45.514120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:45.514574 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:45.514996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:45.643126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:45.650710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cb6fb36c-cca1-4158-81c3-271dd7df81a8 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1314 microversion: 2.1 time: 0.150012 Aug 22 19:56:45.651266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1742/3327] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:45 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:46.671541 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:46.672273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:46.679021 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:46.679502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:46.679965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:46.681095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:46.681095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:46.681523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:46.819336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:46.826802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a072a8a1-95a0-436c-833e-a0085fbec035 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1314 microversion: 2.1 time: 0.160051 Aug 22 19:56:46.827366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1586/3328] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:46 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:47.290742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:56:47.291290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:56:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 19:56:47.848461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:47.848983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:47.858678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:47.859160 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:47.859592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:47.860300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:47.860746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:47.861164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:47.991206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:48.000792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a9672033-0ff1-46f9-b8b5-9c2bb1ef3bcc tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1498 microversion: 2.1 time: 0.156453 Aug 22 19:56:48.001361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1743/3329] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:47 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:48.464474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:48.464965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:48.472044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:48.472542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:48.472977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:48.473654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:48.474132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:48.474548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:48.499616 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:56:48.572949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-58b12e8a-c0a8-4ed2-b6c1-63ab74e5d528 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 204 len: 0 microversion: 2.1 time: 0.113437 Aug 22 19:56:48.573598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1587/3330] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:56:48 2022] DELETE /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 19:56:48.584850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:48.585491 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:48.591440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:48.591953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:48.592391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:48.593084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:48.593538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:48.593963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:48.728094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:48.735660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-63cb092e-426e-46cb-a9e4-b156da0e4516 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1504 microversion: 2.1 time: 0.156891 Aug 22 19:56:48.736232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1744/3331] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:48 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:49.759951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:49.760751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:49.767989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:49.768478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:49.768920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:49.769625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:49.770814 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:49.771244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:49.902852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:49.911046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c0cc303-2b39-4104-9988-7ea59958a479 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1504 microversion: 2.1 time: 0.157294 Aug 22 19:56:49.911608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1588/3332] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:49 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:50.699793 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-b19e52db-d579-4ae1-8fbb-fcaec1804cdf req-20e408bd-2576-4f75-b2d8-f9d7aa0ec94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde18609-3401-446f-bec0-c386ad625f4d", "name": "network-vif-deleted", "tag": "80750e1d-770d-4805-8599-bab3ab60fd03"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:56:50.718972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-b19e52db-d579-4ae1-8fbb-fcaec1804cdf req-20e408bd-2576-4f75-b2d8-f9d7aa0ec94b service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:50.719456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-b19e52db-d579-4ae1-8fbb-fcaec1804cdf req-20e408bd-2576-4f75-b2d8-f9d7aa0ec94b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:50.719921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-b19e52db-d579-4ae1-8fbb-fcaec1804cdf req-20e408bd-2576-4f75-b2d8-f9d7aa0ec94b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:50.731502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-b19e52db-d579-4ae1-8fbb-fcaec1804cdf req-20e408bd-2576-4f75-b2d8-f9d7aa0ec94b service nova] Creating event network-vif-deleted:80750e1d-770d-4805-8599-bab3ab60fd03 for instance bde18609-3401-446f-bec0-c386ad625f4d on hv-cinder-83538 Aug 22 19:56:50.737191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-b19e52db-d579-4ae1-8fbb-fcaec1804cdf req-20e408bd-2576-4f75-b2d8-f9d7aa0ec94b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041078 Aug 22 19:56:50.737781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1745/3333] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:56:50.932403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:50.933046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:50.939513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:50.940034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:50.940468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:50.941158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:50.941611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:50.942037 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:50.972391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:50.972864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:50.973298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:50.973741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lazy-loading 'fault' on Instance uuid bde18609-3401-446f-bec0-c386ad625f4d {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:56:51.014227 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:51.021956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c8824d8-4e12-499b-b1f3-dafc80b1d5e4 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 200 len: 1304 microversion: 2.1 time: 0.093425 Aug 22 19:56:51.022528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1589/3334] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:50 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:52.043667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:52.044395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: bde18609-3401-446f-bec0-c386ad625f4d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:52.051049 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:52.051532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:52.051988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:52.052677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:52.053130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:52.053552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:52.067229 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] HTTP exception thrown: Instance bde18609-3401-446f-bec0-c386ad625f4d could not be found. Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Request method failure captured: Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d HTTP/1.1 Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA99sWd_wVTgmDMoHG62Z9Sq6szqBkKkfcQC9UtKuUx7UCGYYNOc7sWCZqw3CYIJoPlDl_YxzvlkMLHopM9-qkF9rCvSwSC2M7HDsQYte0k6LZcJ0kPA69IP6v55Vft24BhbR-dDnD0pgPn8QYXK6aM5lWhHfQWMs6tPbVBRST_YQVIg Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 532a20c016764748a97e11413dab4aba Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesActionsTest-1117746220 Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:56:52.068903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_532a20c016764748a97e11413dab4aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/532a20c016764748a97e11413dab4aba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/532a20c016764748a97e11413dab4aba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/532a20c016764748a97e11413dab4aba"}]}] Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesActionsTest-1117746220 Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 532a20c016764748a97e11413dab4aba Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesActionsTest-1117746220 Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesActionsTest-1117746220-project Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 8c727c852d63447d89179e17d4731628 Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesActionsTest-1117746220-project Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance bde18609-3401-446f-bec0-c386ad625f4d could not be found. Aug 22 19:56:52.070386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': 'bde18609-3401-446f-bec0-c386ad625f4d'} Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde18609-3401-446f-bec0-c386ad625f4d could not be found. Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:56:52.071204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde18609-3401-446f-bec0-c386ad625f4d could not be found. Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde18609-3401-446f-bec0-c386ad625f4d could not be found. Aug 22 19:56:52.072593 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:56:52.074087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Returning 404 to user: Instance bde18609-3401-446f-bec0-c386ad625f4d could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:56:52.074087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4fcbafc5-c719-476c-a2ed-d9304bb2e42c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d" status: 404 len: 111 microversion: 2.1 time: 0.031470 Aug 22 19:56:52.074087 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1746/3335] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:52 2022] GET /compute/v2.1/servers/bde18609-3401-446f-bec0-c386ad625f4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:56:52.120903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1057804883", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "networks": [{"uuid": "9a0c4efa-e548-4a11-88e8-875e52cd4c37"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:56:52.180009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] validate_networks() for [('9a0c4efa-e548-4a11-88e8-875e52cd4c37', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 19:56:52.531264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 19:56:52.531721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 19:56:52.532199 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 19:56:52.532617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 19:56:52.533028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 19:56:52.541635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:52.542113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:52.542544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:52.543261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:52.543756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:52.544205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:52.561103 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Getting quotas for project 532a20c016764748a97e11413dab4aba. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 19:56:52.565002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Getting quotas for user 8c727c852d63447d89179e17d4731628 and project 532a20c016764748a97e11413dab4aba. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 19:56:52.575996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 19:56:52.578310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 19:56:52.623962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8f8417a7-7399-4868-90fd-feee8261804f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507859 Aug 22 19:56:52.624596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1590/3336] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 19:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 19:56:52.635266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-80f3e038-206f-4029-a1d3-56cfbdf80085 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:52.635902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-80f3e038-206f-4029-a1d3-56cfbdf80085 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:52.689806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-80f3e038-206f-4029-a1d3-56cfbdf80085 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:52.696579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-80f3e038-206f-4029-a1d3-56cfbdf80085 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1214 microversion: 2.1 time: 0.065253 Aug 22 19:56:52.697130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1747/3337] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:52 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:53.719396 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:53.720114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:53.727409 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:53.727915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:53.728343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:53.735998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:53.736523 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:53.736965 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:53.820408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:53.828828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ba0af3c-32c9-4ac0-9624-fc2390c6701f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1272 microversion: 2.1 time: 0.114133 Aug 22 19:56:53.829401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1591/3338] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:53 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:54.849893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:54.850545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:54.859104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:54.859788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:54.860029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:54.860719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:54.861163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:54.861581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:54.869354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-89a47e14-0140-40d5-a26f-61413e1e21f9 req-7031eee5-2c8f-45c0-863b-06cde50a76a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a672bb39-7ee1-4a01-92c1-17f0e677e7c4", "tag": "7aad8c71-a556-42b7-a762-39eaf60dc955"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:56:54.883019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-89a47e14-0140-40d5-a26f-61413e1e21f9 req-7031eee5-2c8f-45c0-863b-06cde50a76a7 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:54.883888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-89a47e14-0140-40d5-a26f-61413e1e21f9 req-7031eee5-2c8f-45c0-863b-06cde50a76a7 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:54.884584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-89a47e14-0140-40d5-a26f-61413e1e21f9 req-7031eee5-2c8f-45c0-863b-06cde50a76a7 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:54.900463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-89a47e14-0140-40d5-a26f-61413e1e21f9 req-7031eee5-2c8f-45c0-863b-06cde50a76a7 service nova] Creating event network-changed:7aad8c71-a556-42b7-a762-39eaf60dc955 for instance a672bb39-7ee1-4a01-92c1-17f0e677e7c4 on hv-cinder-83538 Aug 22 19:56:54.912625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-89a47e14-0140-40d5-a26f-61413e1e21f9 req-7031eee5-2c8f-45c0-863b-06cde50a76a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042020 Aug 22 19:56:54.913583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1592/3339] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:56:55.005805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:55.013563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-40f29650-e5f1-4533-baae-579cf988d7c5 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1314 microversion: 2.1 time: 0.167428 Aug 22 19:56:55.014121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1748/3340] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:54 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:56.035626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:56.036346 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:56.042401 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:56.042880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:56.043321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:56.044036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:56.044490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:56.045611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:56.177029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:56.184860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-20089c67-a5f2-4ab8-974a-7c327c96337c tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1314 microversion: 2.1 time: 0.153916 Aug 22 19:56:56.185452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1593/3341] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:56 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:57.205394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:57.206008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:57.213069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:57.213551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:57.213988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:57.214676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:57.215122 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:57.215544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:57.342528 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:57.350101 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b3c92d00-602f-42ce-9b7d-4290281291de tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1314 microversion: 2.1 time: 0.149076 Aug 22 19:56:57.350669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1749/3342] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:57 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:58.371211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:58.371916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:58.377934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:58.378416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:58.378855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:58.379723 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:58.380175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:58.380596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:58.508568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:58.517140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4eafb973-1702-419b-841a-67adb8ec047e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1314 microversion: 2.1 time: 0.150358 Aug 22 19:56:58.517694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1594/3343] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:58 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:56:59.538445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:56:59.539161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:56:59.546027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:59.546513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:59.546948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:59.547792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:56:59.548290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:56:59.548710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:56:59.683420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:56:59.693641 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c8e6f612-5f69-4d11-88dd-f35912481103 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1314 microversion: 2.1 time: 0.157681 Aug 22 19:56:59.694423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1750/3344] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:56:59 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:57:00.714825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:57:00.715467 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:57:00.717907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:00.723115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:00.723598 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:00.724057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:00.724990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:00.725204 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:00.725629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:00.730003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:00.869646 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:57:00.877247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff1d4c22-7364-4c2c-be54-fcda8132c25f tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1314 microversion: 2.1 time: 0.166324 Aug 22 19:57:00.877804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1595/3345] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:57:00 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:57:01.080878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-50767df4-e453-49c0-b8f6-6b1055ea5e2d req-e3fcbed1-5a60-4cb8-bd7b-94a4559ac996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a672bb39-7ee1-4a01-92c1-17f0e677e7c4", "name": "network-vif-plugged", "status": "completed", "tag": "7aad8c71-a556-42b7-a762-39eaf60dc955"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:57:01.092463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-50767df4-e453-49c0-b8f6-6b1055ea5e2d req-e3fcbed1-5a60-4cb8-bd7b-94a4559ac996 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:01.092941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-50767df4-e453-49c0-b8f6-6b1055ea5e2d req-e3fcbed1-5a60-4cb8-bd7b-94a4559ac996 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:01.093605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-50767df4-e453-49c0-b8f6-6b1055ea5e2d req-e3fcbed1-5a60-4cb8-bd7b-94a4559ac996 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:01.105445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-50767df4-e453-49c0-b8f6-6b1055ea5e2d req-e3fcbed1-5a60-4cb8-bd7b-94a4559ac996 service nova] Creating event network-vif-plugged:7aad8c71-a556-42b7-a762-39eaf60dc955 for instance a672bb39-7ee1-4a01-92c1-17f0e677e7c4 on hv-cinder-83538 Aug 22 19:57:01.110974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-50767df4-e453-49c0-b8f6-6b1055ea5e2d req-e3fcbed1-5a60-4cb8-bd7b-94a4559ac996 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033745 Aug 22 19:57:01.111609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1751/3346] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 19:57:01.897737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:57:01.898332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:57:01.905312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:01.905799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:01.906234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:01.906923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:01.907373 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:01.907829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:02.044063 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:57:02.052138 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9414d41a-9f4a-4870-b052-8302df7e49b2 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1314 microversion: 2.1 time: 0.158261 Aug 22 19:57:02.052703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1596/3347] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:57:01 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:57:03.070779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:03.074916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:57:03.075613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:57:03.077403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=41 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:03.084184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:03.084184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:03.084549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:03.085245 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:03.085693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:03.086288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:03.089187 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=69 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:03.231902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:57:03.240718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0c5e3812-4df4-4160-b947-5aa1f43da83a tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1497 microversion: 2.1 time: 0.171449 Aug 22 19:57:03.241296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1752/3348] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:57:03 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:57:03.767235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:57:03.767816 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:57:03.769669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:03.770437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:03.776881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:03.777353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:03.777782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:03.778470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:03.778971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:03.779392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:03.803887 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 19:57:03.880073 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-91c7622c-b213-4b69-a729-88bdbc203d96 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 204 len: 0 microversion: 2.1 time: 0.116732 Aug 22 19:57:03.880760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1597/3349] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 19:57:03 2022] DELETE /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 19:57:03.889961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:57:03.890563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:57:03.897420 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:03.898033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:03.898564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:03.899414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:03.900074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:03.900591 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:04.033545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:57:04.041217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-94bd96c9-bef5-4fac-ae39-af7f1d5abc97 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1503 microversion: 2.1 time: 0.155391 Aug 22 19:57:04.041791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1753/3350] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:57:03 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 19:57:05.063349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:57:05.064077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:57:05.070589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:05.071076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:05.071516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:05.072256 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:05.072716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:05.073145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:05.213310 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:57:05.221101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec6e20a3-1247-4cd4-b928-6d1016ce064e tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1503 microversion: 2.1 time: 0.162387 Aug 22 19:57:05.221676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1598/3351] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:57:05 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:57:05.938022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-a7b74b09-2467-4338-a5bc-55831dee244e req-3916d117-7af7-4315-971e-be8d1c4184b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a672bb39-7ee1-4a01-92c1-17f0e677e7c4", "name": "network-vif-deleted", "tag": "7aad8c71-a556-42b7-a762-39eaf60dc955"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 19:57:05.948530 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-a7b74b09-2467-4338-a5bc-55831dee244e req-3916d117-7af7-4315-971e-be8d1c4184b3 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:05.949003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-a7b74b09-2467-4338-a5bc-55831dee244e req-3916d117-7af7-4315-971e-be8d1c4184b3 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:05.949433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-a7b74b09-2467-4338-a5bc-55831dee244e req-3916d117-7af7-4315-971e-be8d1c4184b3 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:05.961638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-a7b74b09-2467-4338-a5bc-55831dee244e req-3916d117-7af7-4315-971e-be8d1c4184b3 service nova] Creating event network-vif-deleted:7aad8c71-a556-42b7-a762-39eaf60dc955 for instance a672bb39-7ee1-4a01-92c1-17f0e677e7c4 on hv-cinder-83538 Aug 22 19:57:05.966804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-a7b74b09-2467-4338-a5bc-55831dee244e req-3916d117-7af7-4315-971e-be8d1c4184b3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032928 Aug 22 19:57:05.967763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1754/3352] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 19:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 19:57:06.242435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:57:06.243083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:57:06.250185 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:06.250670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:06.251110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:06.251838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:06.252294 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:06.252719 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:06.283431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:06.283945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:06.284385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:06.284838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lazy-loading 'fault' on Instance uuid a672bb39-7ee1-4a01-92c1-17f0e677e7c4 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 19:57:06.328661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c727c852d63447d89179e17d4731628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a20c016764748a97e11413dab4aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 19:57:06.336801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ce28692-afa3-4f0d-a0f7-f6272ae87482 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 200 len: 1304 microversion: 2.1 time: 0.098400 Aug 22 19:57:06.337384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1599/3353] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:57:06 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 19:57:07.359870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 19:57:07.360486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] [instance: a672bb39-7ee1-4a01-92c1-17f0e677e7c4] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 19:57:07.366706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:07.367185 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:07.367621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:07.368331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 19:57:07.368788 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 19:57:07.369206 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 19:57:07.383665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] HTTP exception thrown: Instance a672bb39-7ee1-4a01-92c1-17f0e677e7c4 could not be found. Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Request method failure captured: Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 HTTP/1.1 Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA99sWd_wVTgmDMoHG62Z9Sq6szqBkKkfcQC9UtKuUx7UCGYYNOc7sWCZqw3CYIJoPlDl_YxzvlkMLHopM9-qkF9rCvSwSC2M7HDsQYte0k6LZcJ0kPA69IP6v55Vft24BhbR-dDnD0pgPn8QYXK6aM5lWhHfQWMs6tPbVBRST_YQVIg Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 532a20c016764748a97e11413dab4aba Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-VolumesActionsTest-1117746220 Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 19:57:07.385316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_532a20c016764748a97e11413dab4aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/532a20c016764748a97e11413dab4aba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/532a20c016764748a97e11413dab4aba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/532a20c016764748a97e11413dab4aba"}]}] Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-VolumesActionsTest-1117746220 Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 532a20c016764748a97e11413dab4aba Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-VolumesActionsTest-1117746220 Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-VolumesActionsTest-1117746220-project Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 8c727c852d63447d89179e17d4731628 Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-VolumesActionsTest-1117746220-project Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance a672bb39-7ee1-4a01-92c1-17f0e677e7c4 could not be found. Aug 22 19:57:07.386631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': 'a672bb39-7ee1-4a01-92c1-17f0e677e7c4'} Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a672bb39-7ee1-4a01-92c1-17f0e677e7c4 could not be found. Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 19:57:07.387342 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a672bb39-7ee1-4a01-92c1-17f0e677e7c4 could not be found. Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a672bb39-7ee1-4a01-92c1-17f0e677e7c4 could not be found. Aug 22 19:57:07.388930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 19:57:07.390455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] Returning 404 to user: Instance a672bb39-7ee1-4a01-92c1-17f0e677e7c4 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 19:57:07.390455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2b633838-960d-4d79-9ee7-c21d5d835307 tempest-VolumesActionsTest-1117746220 tempest-VolumesActionsTest-1117746220-project] 10.222.0.61 "GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4" status: 404 len: 111 microversion: 2.1 time: 0.032369 Aug 22 19:57:07.390455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1755/3354] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 19:57:07 2022] GET /compute/v2.1/servers/a672bb39-7ee1-4a01-92c1-17f0e677e7c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 19:59:34.046532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 19:59:34.047246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 19:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:00:04.979891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:00:04.980518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:00:07.300109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:00:07.300763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 20:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:00:08.331188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:00:08.331751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:00:17.008122 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [716d04fe-a69a-4c0e-a9d8-5f28dd4e75f7] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 22 20:00:17.008960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:17.009697 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:17.014508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:00:17.015007 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:00:17.022327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:00:17.022932 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:00:17.023397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:00:17.024113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:00:17.024569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:00:17.024993 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:00:17.039933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e HTTP/1.1 Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 20:00:17.041595 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.043019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '8b95c1a3-7046-4ae9-aec5-fb8838e1d45e'} Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:00:17.043786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.044987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.046152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:00:17.046152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0e3b6a47-e88a-4025-af96-27da349ff7a2 tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 404 len: 111 microversion: 2.1 time: 0.036687 Aug 22 20:00:17.046152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1600/3355] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 20:00:17 2022] DELETE /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 20:00:17.049435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR oslo.messaging._drivers.impl_rabbit [-] [acf37cf7-2f5d-48fe-8a2e-5c6636de9fab] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 22 20:00:17.050215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=7 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:17.051131 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=15 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:17.055308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:00:17.055953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] [instance: 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:00:17.064120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:00:17.064609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:00:17.065056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:00:17.065748 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:00:17.066203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:00:17.066623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:00:17.080509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] HTTP exception thrown: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Request method failure captured: Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e HTTP/1.1 Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAC2-6y9uO05T2A8GTFPwPV1UJHw4mFswWO1KumUjucaZlLUhKZrOSvu40rozESIsU1hbyEIBCvZZrMkfx6uEbRibfTL0rSJvv4hOQFOyUhS7GgFvDfuAd1knMGjWw6At5kHQRtoNbykXoJFLebqqmNEHOXypOEWxb_3ahMD6CZ3Y Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 20:00:17.082074 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e2b975d3d2d45d384b5a8dd92da782f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e2b975d3d2d45d384b5a8dd92da782f"}]}] Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 1e2b975d3d2d45d384b5a8dd92da782f Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1045815631 Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 61388384a318473e987ab06426509b69 Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeNegativeTest-1045815631-project Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.083454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '8b95c1a3-7046-4ae9-aec5-fb8838e1d45e'} Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:00:17.084162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. Aug 22 20:00:17.085235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:00:17.086193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] Returning 404 to user: Instance 8b95c1a3-7046-4ae9-aec5-fb8838e1d45e could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:00:17.086193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8a7cfef4-d48d-4ddb-817f-b0afc454a7db tempest-AttachVolumeNegativeTest-1045815631 tempest-AttachVolumeNegativeTest-1045815631-project] 10.222.0.61 "GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e" status: 404 len: 111 microversion: 2.1 time: 0.035809 Aug 22 20:00:17.086193 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1756/3356] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:00:17 2022] GET /compute/v2.1/servers/8b95c1a3-7046-4ae9-aec5-fb8838e1d45e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 20:00:23.852390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:00:23.852967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:00:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:00:24.650712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:00:24.651214 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 20:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:01:18.562933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:18.563928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:18.575930 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [716d04fe-a69a-4c0e-a9d8-5f28dd4e75f7] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 51374. Aug 22 20:01:18.804370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-049ae0fe-c6ed-4471-b596-2834fa15475b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Action: 'create', calling method: .version_select at 0x7f66e7f7ff70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1679733680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlJnwtvaLFLNaUVJI6hNex/ZJMwAxkQsxdG/HgRSwI9wNjkvmj1TU/TBwliw+B4vjZt6zwlx4c0nTflLO7Z8pnFOiOT25+9t2hKaneW2qRlHeNVK6V2wuwPbb1bE0m4qA=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:01:18.843164 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-049ae0fe-c6ed-4471-b596-2834fa15475b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Getting quotas for project e769d7a29dbc470f9013344d9c817d63. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 20:01:18.849859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-049ae0fe-c6ed-4471-b596-2834fa15475b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Getting quotas for user ae3afb9ab5c3485287cc352735a159b8 and project e769d7a29dbc470f9013344d9c817d63. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 20:01:18.889303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-049ae0fe-c6ed-4471-b596-2834fa15475b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.328412 Aug 22 20:01:18.890333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1601/3357] 10.222.0.61 () {60 vars in 1159 bytes} [Mon Aug 22 20:01:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:01:44.236584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:44.237330 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:44.241561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:44.242061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:44.250616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:44.251088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:44.251525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:44.252250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:44.252703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:44.253118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:44.257423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] [acf37cf7-2f5d-48fe-8a2e-5c6636de9fab] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 51564. Aug 22 20:01:44.280749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Going to try to terminate instance {{(pid=120639) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 20:01:44.359774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-7f68dbfd-05e4-4ba9-992e-7c01a61a9a4d tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 204 len: 0 microversion: 2.1 time: 0.124567 Aug 22 20:01:44.360453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1757/3358] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 20:01:44 2022] DELETE /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 20:01:44.366202 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:44.366964 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:44.371266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:44.371907 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:44.381128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:44.381619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:44.382059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:44.382764 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:44.383219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:44.383668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:44.625374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:44.633168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-726b3d4a-91bd-4f73-959c-6565d6384954 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1507 microversion: 2.1 time: 0.268236 Aug 22 20:01:44.633738 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1602/3359] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:44 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:45.654690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:45.655383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:45.663438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:45.663955 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:45.664390 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:45.665088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:45.665535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:45.665953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:45.884088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:45.894440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e7397349-aa4b-4f2e-b28c-a8eea0e70181 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1507 microversion: 2.1 time: 0.243949 Aug 22 20:01:45.895752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1758/3360] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:45 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:45.919300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1598962119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1679733680", "security_groups": [{"name": "tempest-secgroup-smoke-1712084698"}], "networks": [{"uuid": "b392bd0e-3b6f-419c-a26c-263e649fa1ed"}], "block_device_mapping_v2": [{"uuid": "bfdbe39c-01e3-4491-af13-4ccc8fe24b29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:01:46.099442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] validate_networks() for [('b392bd0e-3b6f-419c-a26c-263e649fa1ed', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 20:01:46.619790 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-6a6a68e4-9e9b-4423-ae13-afe415faffbc req-09933e8c-2f52-45bc-a111-6deb76388113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d520aec1-59d4-4169-9eea-84ec30203610", "name": "network-vif-deleted", "tag": "d79a28ec-9fd6-4fed-bcad-77de1d3b3f63"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:01:46.630527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-6a6a68e4-9e9b-4423-ae13-afe415faffbc req-09933e8c-2f52-45bc-a111-6deb76388113 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:46.631100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-6a6a68e4-9e9b-4423-ae13-afe415faffbc req-09933e8c-2f52-45bc-a111-6deb76388113 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:46.631598 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-6a6a68e4-9e9b-4423-ae13-afe415faffbc req-09933e8c-2f52-45bc-a111-6deb76388113 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:46.644162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-6a6a68e4-9e9b-4423-ae13-afe415faffbc req-09933e8c-2f52-45bc-a111-6deb76388113 service nova] Creating event network-vif-deleted:d79a28ec-9fd6-4fed-bcad-77de1d3b3f63 for instance d520aec1-59d4-4169-9eea-84ec30203610 on hv-cinder-83538 Aug 22 20:01:46.648719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-6a6a68e4-9e9b-4423-ae13-afe415faffbc req-09933e8c-2f52-45bc-a111-6deb76388113 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156500 Aug 22 20:01:46.649648 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1759/3361] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:01:46.759413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 20:01:46.759967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 20:01:46.760534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 20:01:46.761066 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 20:01:46.761577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 20:01:46.773561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:46.774101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:46.774544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:46.775275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:46.775892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:46.776328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:46.796942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Getting quotas for project e769d7a29dbc470f9013344d9c817d63. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 20:01:46.801404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Getting quotas for user ae3afb9ab5c3485287cc352735a159b8 and project e769d7a29dbc470f9013344d9c817d63. Resources: {'instances', 'cores', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 20:01:46.863996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 20:01:46.866453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfdbe39c-01e3-4491-af13-4ccc8fe24b29',volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 20:01:46.917158 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:46.918005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:46.925716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:46.926610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:46.927153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:46.927902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:46.928532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:46.928992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:46.966697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:46.967175 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:46.967602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:46.968148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lazy-loading 'fault' on Instance uuid d520aec1-59d4-4169-9eea-84ec30203610 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 20:01:47.020819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:47.030263 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3d42fee6-c3ee-4b92-9469-c3a2f818cec5 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 200 len: 1312 microversion: 2.1 time: 0.117846 Aug 22 20:01:47.030805 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1760/3362] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:46 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 20:01:47.040145 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64bfda39-e473-438c-9661-27efb7df8f9f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.125139 Aug 22 20:01:47.047872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1603/3363] 10.222.0.61 () {60 vars in 1147 bytes} [Mon Aug 22 20:01:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 20:01:47.055956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-08218635-3bef-4365-a7e7-7282e7d167dc tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:47.056573 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-08218635-3bef-4365-a7e7-7282e7d167dc tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:47.119270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-08218635-3bef-4365-a7e7-7282e7d167dc tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:47.127411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-08218635-3bef-4365-a7e7-7282e7d167dc tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1089 microversion: 2.1 time: 0.075434 Aug 22 20:01:47.128467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1761/3364] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:47 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:48.051977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:48.052601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: d520aec1-59d4-4169-9eea-84ec30203610] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:48.060235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:48.060739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:48.061181 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:48.061911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:48.062376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:48.062806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:48.081482 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Instance d520aec1-59d4-4169-9eea-84ec30203610 could not be found. Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 HTTP/1.1 Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 20:01:48.083217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance d520aec1-59d4-4169-9eea-84ec30203610 could not be found. Aug 22 20:01:48.084553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': 'd520aec1-59d4-4169-9eea-84ec30203610'} Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d520aec1-59d4-4169-9eea-84ec30203610 could not be found. Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:01:48.085297 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d520aec1-59d4-4169-9eea-84ec30203610 could not be found. Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d520aec1-59d4-4169-9eea-84ec30203610 could not be found. Aug 22 20:01:48.086462 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:01:48.087544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 404 to user: Instance d520aec1-59d4-4169-9eea-84ec30203610 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:01:48.087544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d71ecc0c-4229-4ca2-aa45-7cb834534dd1 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610" status: 404 len: 111 microversion: 2.1 time: 0.037067 Aug 22 20:01:48.087544 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1604/3365] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:48 2022] GET /compute/v2.1/servers/d520aec1-59d4-4169-9eea-84ec30203610 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 20:01:48.096607 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:48.097123 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:48.104472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:48.104962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:48.105396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:48.106104 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:48.106558 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:48.106984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:48.146523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Going to try to terminate instance {{(pid=120639) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 20:01:48.148803 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c740e8e5-a571-4190-a6d3-8a8900bffe87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:48.150101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c740e8e5-a571-4190-a6d3-8a8900bffe87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:48.213344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c740e8e5-a571-4190-a6d3-8a8900bffe87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:48.223412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c740e8e5-a571-4190-a6d3-8a8900bffe87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1089 microversion: 2.1 time: 0.077929 Aug 22 20:01:48.235669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1605/3366] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:48 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1089 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 20:01:48.246873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6f410cdd-aef3-4629-bed8-90fd58ce3444 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 204 len: 0 microversion: 2.1 time: 0.154004 Aug 22 20:01:48.251113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1762/3367] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 20:01:48 2022] DELETE /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 20:01:48.259489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:48.260442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:48.271334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:48.272166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:48.272892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:48.273732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:48.274187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:48.274611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:48.433413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:48.442069 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-225b00b7-b91f-452f-add1-f83e95e6475f tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.189207 Aug 22 20:01:48.442652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1606/3368] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:48 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:49.245547 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-09711be6-db38-411e-9a25-854cd8a271d6 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:49.246254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-09711be6-db38-411e-9a25-854cd8a271d6 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:49.300221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-09711be6-db38-411e-9a25-854cd8a271d6 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:49.307936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-09711be6-db38-411e-9a25-854cd8a271d6 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1089 microversion: 2.1 time: 0.066650 Aug 22 20:01:49.308455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1763/3369] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:49 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:49.462820 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:49.463910 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:49.472322 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:49.472957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:49.473612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:49.474443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:49.475141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:49.476414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:49.719430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8030a8ebdd8c45c7bd30403c866a9278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3308fc667c4b8c8552e27ba69d40fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:49.727621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-03410a9f-36d1-4d1f-9c21-50d9ded95495 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 200 len: 1522 microversion: 2.1 time: 0.268733 Aug 22 20:01:49.728375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1607/3370] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:49 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 20:01:49.970144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-1a8efc25-9e51-4aab-9f5c-786380241765 req-244f6133-679d-4bfa-8caa-8528f70b93a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b", "name": "network-vif-deleted", "tag": "bc74abd6-9202-4de7-a53d-ab99cb9d76f0"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:01:49.980734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-1a8efc25-9e51-4aab-9f5c-786380241765 req-244f6133-679d-4bfa-8caa-8528f70b93a8 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:49.981217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-1a8efc25-9e51-4aab-9f5c-786380241765 req-244f6133-679d-4bfa-8caa-8528f70b93a8 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:49.981670 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-1a8efc25-9e51-4aab-9f5c-786380241765 req-244f6133-679d-4bfa-8caa-8528f70b93a8 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:49.993447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-1a8efc25-9e51-4aab-9f5c-786380241765 req-244f6133-679d-4bfa-8caa-8528f70b93a8 service nova] Creating event network-vif-deleted:bc74abd6-9202-4de7-a53d-ab99cb9d76f0 for instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b on hv-cinder-83538 Aug 22 20:01:49.998505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-1a8efc25-9e51-4aab-9f5c-786380241765 req-244f6133-679d-4bfa-8caa-8528f70b93a8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032792 Aug 22 20:01:49.999435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1764/3371] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:01:50.329872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f12bdbec-0a11-4bd7-81a4-0048f9f41b80 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:50.330477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f12bdbec-0a11-4bd7-81a4-0048f9f41b80 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:50.383744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f12bdbec-0a11-4bd7-81a4-0048f9f41b80 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:50.391631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f12bdbec-0a11-4bd7-81a4-0048f9f41b80 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1089 microversion: 2.1 time: 0.066312 Aug 22 20:01:50.392239 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1608/3372] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:50 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:50.752409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:50.753863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] [instance: 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:50.759687 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:50.760484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:50.760924 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:50.761640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:50.762097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:50.762521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:50.776854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] HTTP exception thrown: Instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b could not be found. Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Request method failure captured: Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b HTTP/1.1 Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA9aAiRZYzQrs3hPxMm_G0-myqiHr3QmEgxt1lNYNNSX09MBHMFyYS6fg9MCASszLoslnxM04q0-tGomOLE9ADPWQTNn7QdHVSiJp-oKtiUMsN-TZUYWyJPLiX2qsUa957ijYgtdEgAwaTM-BTXg-lvEN1N_KDFyis8TK0NT3Z8xzM4E Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 20:01:50.778698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e3308fc667c4b8c8552e27ba69d40fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e3308fc667c4b8c8552e27ba69d40fc"}]}] Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 0e3308fc667c4b8c8552e27ba69d40fc Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726262250 Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: 8030a8ebdd8c45c7bd30403c866a9278 Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726262250-project Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b could not be found. Aug 22 20:01:50.780033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b'} Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b could not be found. Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:01:50.780801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b could not be found. Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b could not be found. Aug 22 20:01:50.782514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:01:50.783559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] Returning 404 to user: Instance 6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:01:50.783559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5dc6e5d8-1480-4f1a-822d-3e41d83426f9 tempest-ServerRescueNegativeTestJSON-1726262250 tempest-ServerRescueNegativeTestJSON-1726262250-project] 10.222.0.61 "GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b" status: 404 len: 111 microversion: 2.1 time: 0.034112 Aug 22 20:01:50.783559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1765/3373] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:50 2022] GET /compute/v2.1/servers/6b8bf9bd-21c7-44d6-b64f-01dc3370ba3b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 20:01:51.414281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:51.415312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:51.424665 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:51.425168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:51.425613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:51.426323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:51.427727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:51.428175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:51.566323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:51.577955 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c08acb2-f5bb-41a9-aee4-f7c489c3e32c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1205 microversion: 2.1 time: 0.166839 Aug 22 20:01:51.580184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1609/3374] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:51 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1205 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:52.611473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:52.612950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:52.620408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:52.621077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:52.621635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:52.622654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:52.623360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:52.623922 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:52.705235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:52.711820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-484d2e49-9f86-47f9-9e95-02fae1f5c356 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1193 microversion: 2.1 time: 0.113241 Aug 22 20:01:52.712954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1766/3375] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:52 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1193 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:53.736089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:53.737366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:53.746212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:53.746928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:53.748233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:53.751819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:53.752716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:53.753339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:53.945498 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-6ccf1308-f788-4bcc-9ef0-1aef8561b283 req-1126360e-ee8b-471c-8d13-353254af0122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720e548c-fdb5-49f9-93cc-ff4aa7864b0d", "tag": "5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:01:53.966354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-6ccf1308-f788-4bcc-9ef0-1aef8561b283 req-1126360e-ee8b-471c-8d13-353254af0122 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:53.966610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-6ccf1308-f788-4bcc-9ef0-1aef8561b283 req-1126360e-ee8b-471c-8d13-353254af0122 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:53.967323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-6ccf1308-f788-4bcc-9ef0-1aef8561b283 req-1126360e-ee8b-471c-8d13-353254af0122 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:53.991712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-6ccf1308-f788-4bcc-9ef0-1aef8561b283 req-1126360e-ee8b-471c-8d13-353254af0122 service nova] Creating event network-changed:5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c for instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d on hv-cinder-83538 Aug 22 20:01:54.001174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-6ccf1308-f788-4bcc-9ef0-1aef8561b283 req-1126360e-ee8b-471c-8d13-353254af0122 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060175 Aug 22 20:01:54.002891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1767/3376] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 20:01:54.024942 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:54.042442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13f6b84f-b365-4eea-9882-c7ff92a7130c tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.311866 Aug 22 20:01:54.044980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1610/3377] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:53 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:55.073642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:55.073642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:55.078313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:55.079309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:55.079792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:55.080503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:55.081300 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:55.082170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:55.284801 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:55.294742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1e58d5e5-9b78-4021-9cb8-9c9ab6f6898e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.227935 Aug 22 20:01:55.295377 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1768/3378] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:55 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:56.320669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:56.321050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:56.330792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:56.331740 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:56.332516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:56.333920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:56.334412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:56.334844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:56.488784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:56.497062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d314356c-cc64-4d24-8c63-b9693db8ba8d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.182941 Aug 22 20:01:56.497647 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1611/3379] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:56 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:57.519095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:57.519937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:57.528450 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:57.529207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:57.529642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:57.530658 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:57.531099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:57.531731 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:57.695638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:57.704883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5b2b5100-f2e3-49a4-9afa-9e7e4db1d1fa tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.189903 Aug 22 20:01:57.711725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1769/3380] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:57 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:01:58.727596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:01:58.729137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:01:58.731386 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:58.743448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:58.743974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:58.744600 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:58.745484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:01:58.745767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:01:58.746189 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:01:58.980767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:01:58.990045 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-109d422f-b1d5-4776-beaf-057a86f55e81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.266723 Aug 22 20:01:58.990857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1612/3381] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:01:58 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:02:00.011194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:00.013107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:00.016542 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:00.023217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:00.024624 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:00.025448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:00.027215 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:00.027682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:00.028279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:00.204174 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:00.214505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-59e4e34e-48e7-47e4-952f-23dbc05f716b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.207092 Aug 22 20:02:00.215097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1770/3382] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:02:00 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:02:01.240210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:01.241320 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:01.246484 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:01.252328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:01.252828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:01.253261 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:01.253983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:01.254436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:01.254858 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:01.419240 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:01.428065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbd6c4a5-d210-447a-838d-981374384643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.195243 Aug 22 20:02:01.428637 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1613/3383] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:02:01 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:02:01.549570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-29882409-3218-499f-a79b-f2f607aa7dd1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'create', calling method: .version_select at 0x7f66df15ab80>, body: {"keypair": {"name": "tempest-keypair-485125352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyQoQSjV1YuaMW+vgSNoFs1CNnRBObcr12VUYLRzWBLGk8UGylyMxXslUMJiaEdjMfD+qvu/QSrqgS2q39+J253vFbkKR1lTqHVJPui1Mna9KGKPTIsmQ5yH0Q8WmhKrg=="}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:02:01.565257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-29882409-3218-499f-a79b-f2f607aa7dd1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Getting quotas for project 548a965fed81436fa0440d4c4db00e2c. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 20:02:01.569196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-29882409-3218-499f-a79b-f2f607aa7dd1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Getting quotas for user e0dc5256349a442db02b6e5584872356 and project 548a965fed81436fa0440d4c4db00e2c. Resources: {'key_pairs'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 20:02:01.594960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-29882409-3218-499f-a79b-f2f607aa7dd1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.190581 Aug 22 20:02:01.595563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1771/3384] 10.222.0.61 () {62 vars in 1200 bytes} [Mon Aug 22 20:02:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 22 20:02:02.448972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:02.450323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:02.458567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:02.459081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:02.459516 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:02.460375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:02.460890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:02.461324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:02.708216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:02.722579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2e4f4405-08a7-4d15-9306-b088e814caf7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.277267 Aug 22 20:02:02.736158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1614/3385] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:02:02 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:02:03.094140 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-75974698", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d830740-8f11-4d20-9890-977a8dc6156a"}], "security_groups": [{"name": "tempest-securitygroup--1958187627"}], "key_name": "tempest-keypair-485125352", "user_data": "}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:02:03.215356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] validate_networks() for [('5d830740-8f11-4d20-9890-977a8dc6156a', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 20:02:03.705768 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 20:02:03.706198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 20:02:03.706673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 20:02:03.707085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 20:02:03.707664 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 20:02:03.716657 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:03.718349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:03.718862 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:03.719550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:03.720202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:03.720850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:03.739777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Getting quotas for project 548a965fed81436fa0440d4c4db00e2c. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 20:02:03.744107 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Getting quotas for user e0dc5256349a442db02b6e5584872356 and project 548a965fed81436fa0440d4c4db00e2c. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 20:02:03.758962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:03.759802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:03.762749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 20:02:03.767031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:03.767767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:03.768210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:03.768947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:03.769163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 20:02:03.769387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:03.769815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:03.840785 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f0b3fb97-f14b-4b01-ab75-d349efad761f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.752755 Aug 22 20:02:03.841741 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1772/3386] 10.222.0.61 () {62 vars in 1188 bytes} [Mon Aug 22 20:02:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 20:02:03.853654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-83b319d5-7e8a-4357-92e3-5802cde18b59 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:03.854180 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-83b319d5-7e8a-4357-92e3-5802cde18b59 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:03.934644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:03.947385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a1cb3a9-fa35-4bb1-93fc-a314744c20db tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.192726 Aug 22 20:02:03.948403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1615/3387] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:02:03 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 20:02:03.964813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-83b319d5-7e8a-4357-92e3-5802cde18b59 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:03.974156 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-83b319d5-7e8a-4357-92e3-5802cde18b59 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:03.975676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-83b319d5-7e8a-4357-92e3-5802cde18b59 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:03.976804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-83b319d5-7e8a-4357-92e3-5802cde18b59 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1279 microversion: 2.20 time: 0.127976 Aug 22 20:02:03.977564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1773/3388] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:03 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1279 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:02:04.971186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:04.971847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:04.989919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:04.990408 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:04.990843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:04.991549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:04.992032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:04.992459 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:05.001283 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:05.003257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:05.026815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:05.029537 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:05.030659 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:05.032618 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:05.036110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:05.037639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:05.137949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:05.151721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:05.154299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:05.156224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9445ef72-4f57-42a2-8a09-2ccaefd53a62 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1331 microversion: 2.20 time: 0.160451 Aug 22 20:02:05.157005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1774/3389] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:04 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:02:05.201702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:05.213721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7a5920e-95e9-4497-990b-0183d7b16bc9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.247518 Aug 22 20:02:05.215787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1616/3390] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:02:04 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:02:05.810118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-20e81cc7-3ee5-4e04-88f6-b478bc704dd9 req-023256f3-93e2-4a6d-935d-258b2b9f9daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720e548c-fdb5-49f9-93cc-ff4aa7864b0d", "name": "network-vif-plugged", "status": "completed", "tag": "5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:02:05.824022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-20e81cc7-3ee5-4e04-88f6-b478bc704dd9 req-023256f3-93e2-4a6d-935d-258b2b9f9daa service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:05.825145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-20e81cc7-3ee5-4e04-88f6-b478bc704dd9 req-023256f3-93e2-4a6d-935d-258b2b9f9daa service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:05.826672 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-20e81cc7-3ee5-4e04-88f6-b478bc704dd9 req-023256f3-93e2-4a6d-935d-258b2b9f9daa service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:05.842024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-20e81cc7-3ee5-4e04-88f6-b478bc704dd9 req-023256f3-93e2-4a6d-935d-258b2b9f9daa service nova] Creating event network-vif-plugged:5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c for instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d on hv-cinder-83538 Aug 22 20:02:05.848544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-20e81cc7-3ee5-4e04-88f6-b478bc704dd9 req-023256f3-93e2-4a6d-935d-258b2b9f9daa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112799 Aug 22 20:02:05.849178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1775/3391] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 20:02:06.182303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:06.183702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:06.192792 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:06.194166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:06.194884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:06.195808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:06.196658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:06.197306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:06.242706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:06.243406 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:06.257557 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:06.258111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:06.258551 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:06.259269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:06.259750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:06.260349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:06.447005 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:06.456355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2dc574d3-d6ff-48d8-83cb-68bc5fd1b540 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.217779 Aug 22 20:02:06.457463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1776/3392] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:02:06 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 20:02:06.475224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:06.485136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:06.486656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:06.487826 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65cfa2d9-9b08-48f8-aff5-72258d47fbe8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1405 microversion: 2.20 time: 0.310694 Aug 22 20:02:06.488594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1617/3393] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:06 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:02:06.925089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-6d677441-8db2-44a3-b5a4-eb7039d92397 req-1f2a65a2-f1bc-48d2-a557-b57eb00180de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0abc09a-44e2-4162-b11e-b6887fc66f36", "tag": "ddb352c2-1c0e-4390-8b85-3d6051d1673a"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:02:06.934708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-6d677441-8db2-44a3-b5a4-eb7039d92397 req-1f2a65a2-f1bc-48d2-a557-b57eb00180de service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:06.935183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-6d677441-8db2-44a3-b5a4-eb7039d92397 req-1f2a65a2-f1bc-48d2-a557-b57eb00180de service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:06.935620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-6d677441-8db2-44a3-b5a4-eb7039d92397 req-1f2a65a2-f1bc-48d2-a557-b57eb00180de service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:06.947552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-6d677441-8db2-44a3-b5a4-eb7039d92397 req-1f2a65a2-f1bc-48d2-a557-b57eb00180de service nova] Creating event network-changed:ddb352c2-1c0e-4390-8b85-3d6051d1673a for instance c0abc09a-44e2-4162-b11e-b6887fc66f36 on hv-cinder-83538 Aug 22 20:02:06.953149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-6d677441-8db2-44a3-b5a4-eb7039d92397 req-1f2a65a2-f1bc-48d2-a557-b57eb00180de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031856 Aug 22 20:02:06.954016 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1777/3394] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:02:07.477602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:07.478354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:07.485725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:07.486219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:07.486662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:07.487378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:07.487909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:07.488480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:07.512395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:07.513419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:07.520203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:07.520783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:07.521417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:07.522113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:07.522565 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:07.523139 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:07.543246 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:07.629006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:07.640865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c183f96-bec8-45c0-825e-6f6688628407 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1261 microversion: 2.1 time: 0.166613 Aug 22 20:02:07.641917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1618/3395] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:02:07 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:02:07.675879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:07.690673 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:07.693017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:07.695058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e868df90-8b0a-431f-a486-1f9c4a617e32 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1405 microversion: 2.20 time: 0.187200 Aug 22 20:02:07.695915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1778/3396] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:07 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:02:08.662232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:08.662783 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:08.669186 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:08.669659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:08.670086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:08.671281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:08.671761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:08.672182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:08.736616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:08.739103 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:08.749255 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:08.750018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:08.750454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:08.751157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:08.751602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:08.752148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:08.819175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:08.827114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a552a8ac-2bb2-4855-a614-8bd27e661829 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1445 microversion: 2.1 time: 0.168723 Aug 22 20:02:08.827702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1619/3397] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:02:08 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:02:08.847842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:08.847949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:08.854184 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:08.854664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:08.855096 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:08.855813 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:08.856265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:08.856682 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:08.905860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:08.914465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:08.915923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:08.917053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eec1782e-3b80-445d-b344-9e45c6a2875d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1405 microversion: 2.20 time: 0.191696 Aug 22 20:02:08.917621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1779/3398] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:08 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:02:08.994226 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:09.002677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa0e8093-aff0-44e3-8b6c-3521f609fe3e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1445 microversion: 2.1 time: 0.159058 Aug 22 20:02:09.003251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1620/3399] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:02:08 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 20:02:09.940486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:09.941109 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:09.947461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:09.948154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:09.948714 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:09.949411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:09.949861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:09.950288 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:10.172250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:10.181981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:10.184099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:10.185224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-57259abb-fb20-4c7c-bc0a-dca36875c5af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1405 microversion: 2.20 time: 0.249192 Aug 22 20:02:10.185817 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1780/3400] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:09 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1405 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:02:11.032235 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-90851a1c-1e56-4a06-8b80-f06fc4fd012c req-12eafa7a-0d47-46c9-b984-afef6c969339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720e548c-fdb5-49f9-93cc-ff4aa7864b0d", "tag": "5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:02:11.041611 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90851a1c-1e56-4a06-8b80-f06fc4fd012c req-12eafa7a-0d47-46c9-b984-afef6c969339 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:11.042094 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90851a1c-1e56-4a06-8b80-f06fc4fd012c req-12eafa7a-0d47-46c9-b984-afef6c969339 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:11.042524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-90851a1c-1e56-4a06-8b80-f06fc4fd012c req-12eafa7a-0d47-46c9-b984-afef6c969339 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:11.054332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-90851a1c-1e56-4a06-8b80-f06fc4fd012c req-12eafa7a-0d47-46c9-b984-afef6c969339 service nova] Creating event network-changed:5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c for instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d on hv-cinder-83538 Aug 22 20:02:11.060273 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-90851a1c-1e56-4a06-8b80-f06fc4fd012c req-12eafa7a-0d47-46c9-b984-afef6c969339 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094672 Aug 22 20:02:11.060900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1621/3401] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 20:02:11.206627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:11.207380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:11.213949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:11.214543 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:11.215075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:11.215892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:11.216460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:11.216977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:11.357854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:11.366810 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:11.368341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:11.369445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e567015d-6611-42b7-94c9-485a4d35ed7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1405 microversion: 2.20 time: 0.167023 Aug 22 20:02:11.369999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1781/3402] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:11 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:02:12.393648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:12.394271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:12.400428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:12.400917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:12.401446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:12.402148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:12.402603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:12.403032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:12.422203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:12.536695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:12.544947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:12.546463 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:12.547568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5abe011-756c-4f17-81d7-41a865dc6f3a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1405 microversion: 2.20 time: 0.159398 Aug 22 20:02:12.548157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1622/3403] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:12 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:02:13.570226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:13.570820 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:13.577314 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:13.577792 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:13.578226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:13.579203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:13.579702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:13.580127 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:13.719957 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:13.728168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:13.729758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:13.731161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4f056cec-6223-455f-af2d-98d09c61d192 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1405 microversion: 2.20 time: 0.164620 Aug 22 20:02:13.731948 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1782/3404] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:13 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:02:13.760604 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-10f57e8b-204c-4879-a220-33163299e3f0 req-da61743a-3fa8-45aa-bab6-b736da997af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0abc09a-44e2-4162-b11e-b6887fc66f36", "name": "network-vif-plugged", "status": "completed", "tag": "ddb352c2-1c0e-4390-8b85-3d6051d1673a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:02:13.772991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-10f57e8b-204c-4879-a220-33163299e3f0 req-da61743a-3fa8-45aa-bab6-b736da997af4 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:13.773845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-10f57e8b-204c-4879-a220-33163299e3f0 req-da61743a-3fa8-45aa-bab6-b736da997af4 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:13.774292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-10f57e8b-204c-4879-a220-33163299e3f0 req-da61743a-3fa8-45aa-bab6-b736da997af4 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:13.786875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-10f57e8b-204c-4879-a220-33163299e3f0 req-da61743a-3fa8-45aa-bab6-b736da997af4 service nova] Creating event network-vif-plugged:ddb352c2-1c0e-4390-8b85-3d6051d1673a for instance c0abc09a-44e2-4162-b11e-b6887fc66f36 on hv-cinder-83538 Aug 22 20:02:13.791946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-10f57e8b-204c-4879-a220-33163299e3f0 req-da61743a-3fa8-45aa-bab6-b736da997af4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Aug 22 20:02:13.792731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1623/3405] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 20:02:14.755017 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:14.755625 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:14.757639 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:14.758329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=12 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:14.758956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:14.765054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:14.765534 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:14.765975 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:14.766671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:14.767119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:14.767544 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:14.900323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:14.908915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:14.910425 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:14.911531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-404da635-a94e-4b34-9749-7fe18d01e266 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1405 microversion: 2.20 time: 0.160405 Aug 22 20:02:14.912138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1783/3406] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:14 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:02:15.935214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:15.936474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:15.938360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:15.944233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:15.944720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:15.945157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:15.945881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:15.946305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:15.946774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:16.081681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:16.090343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:16.091896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:16.093014 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0311f846-50f5-43f0-8ed2-e0ce55bfb7d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1405 microversion: 2.20 time: 0.162523 Aug 22 20:02:16.093572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1624/3407] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:15 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:02:17.114987 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:17.115595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:17.122165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:17.122649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:17.123084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:17.124398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:17.124850 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:17.125274 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:17.253733 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:17.261746 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:17.263234 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:02:17.264418 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0fb19ebc-423d-4521-abe4-20fcf6d5bb50 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1597 microversion: 2.20 time: 0.153392 Aug 22 20:02:17.264965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1784/3408] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:02:17 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:02:17.286154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dcbaa573-9088-45d5-b34e-466193227c09 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:02:17.286670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dcbaa573-9088-45d5-b34e-466193227c09 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:02:17.293074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcbaa573-9088-45d5-b34e-466193227c09 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:17.293549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcbaa573-9088-45d5-b34e-466193227c09 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:17.293978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcbaa573-9088-45d5-b34e-466193227c09 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:17.294662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcbaa573-9088-45d5-b34e-466193227c09 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:17.295105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcbaa573-9088-45d5-b34e-466193227c09 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:17.296165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dcbaa573-9088-45d5-b34e-466193227c09 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:17.376661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dcbaa573-9088-45d5-b34e-466193227c09 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094279 Aug 22 20:02:17.377250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1625/3409] 10.222.0.61 () {60 vars in 1316 bytes} [Mon Aug 22 20:02:17 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 20:02:18.542056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-67e42aeb-6ab1-4f51-9972-3d9719034fbd req-2bb87e78-f026-4188-9220-05b06f194215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0abc09a-44e2-4162-b11e-b6887fc66f36", "tag": "ddb352c2-1c0e-4390-8b85-3d6051d1673a"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:02:18.554467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-67e42aeb-6ab1-4f51-9972-3d9719034fbd req-2bb87e78-f026-4188-9220-05b06f194215 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:02:18.554942 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-67e42aeb-6ab1-4f51-9972-3d9719034fbd req-2bb87e78-f026-4188-9220-05b06f194215 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:02:18.555364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-67e42aeb-6ab1-4f51-9972-3d9719034fbd req-2bb87e78-f026-4188-9220-05b06f194215 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:02:18.566589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-67e42aeb-6ab1-4f51-9972-3d9719034fbd req-2bb87e78-f026-4188-9220-05b06f194215 service nova] Creating event network-changed:ddb352c2-1c0e-4390-8b85-3d6051d1673a for instance c0abc09a-44e2-4162-b11e-b6887fc66f36 on hv-cinder-83538 Aug 22 20:02:18.571802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-67e42aeb-6ab1-4f51-9972-3d9719034fbd req-2bb87e78-f026-4188-9220-05b06f194215 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033300 Aug 22 20:02:18.572550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1785/3410] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:03:33.755747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:33.756511 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=14 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:33.761167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca17eba0-270b-4e7d-a086-e78ec89efa96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:33.761673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca17eba0-270b-4e7d-a086-e78ec89efa96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:33.768631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca17eba0-270b-4e7d-a086-e78ec89efa96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:33.769123 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca17eba0-270b-4e7d-a086-e78ec89efa96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:33.769583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca17eba0-270b-4e7d-a086-e78ec89efa96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:33.770275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca17eba0-270b-4e7d-a086-e78ec89efa96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:33.770729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca17eba0-270b-4e7d-a086-e78ec89efa96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:33.771158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca17eba0-270b-4e7d-a086-e78ec89efa96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:33.796612 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca17eba0-270b-4e7d-a086-e78ec89efa96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/ips" status: 200 len: 152 microversion: 2.20 time: 0.042709 Aug 22 20:03:33.797690 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1626/3411] 10.222.0.61 () {60 vars in 1289 bytes} [Mon Aug 22 20:03:33 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 20:03:36.750387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=5 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:36.751280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=40 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:36.755502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:03:36.756178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:36.763834 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:36.764172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:36.764613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:36.765310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:36.765764 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:36.766201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:36.789654 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lazy-loading 'flavor' on Instance uuid c0abc09a-44e2-4162-b11e-b6887fc66f36 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 20:03:36.985683 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6673b37a-a8d3-4c5d-90aa-7a6ec75b687d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/action" status: 202 len: 0 microversion: 2.20 time: 0.236959 Aug 22 20:03:36.986280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1786/3412] 10.222.0.61 () {62 vars in 1319 bytes} [Mon Aug 22 20:03:36 2022] POST /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 20:03:36.994686 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:36.995305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:37.002694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:37.003081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:37.003530 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:37.004306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:37.004786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:37.005437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:37.150031 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:37.159602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:37.161148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:37.162291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb7bc7bb-9d1f-4aab-80f1-870bd2c059a0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.171772 Aug 22 20:03:37.162847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1627/3413] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:36 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:38.188182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:38.188878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:38.195971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:38.196455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:38.196883 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:38.197578 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:38.198027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:38.198449 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:38.343604 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:38.351915 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:38.353427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:38.354605 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1ef7bb2f-426f-4ec5-a07d-a8c9d3ee73a8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.171876 Aug 22 20:03:38.355169 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1787/3414] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:38 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:39.377515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:39.378133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:39.384667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:39.385180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:39.385614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:39.386345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:39.386799 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:39.387222 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:39.525019 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:39.534172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:39.535711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:39.536920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3371c313-b40c-47dd-9b76-fb171e5fb86c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.163373 Aug 22 20:03:39.537486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1628/3415] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:39 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:40.560561 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:40.561226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:40.567719 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:40.568201 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:40.568635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:40.569329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:40.569774 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:40.570212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:40.707125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:40.715725 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:40.717228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:40.718394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e0b18815-6705-4199-9bab-2ba570e83f05 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.162263 Aug 22 20:03:40.718950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1788/3416] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:40 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:41.741845 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:41.742542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:41.754618 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:41.755108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:41.755542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:41.756308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:41.756760 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:41.757211 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:41.895534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:41.904344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:41.905901 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:41.907080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2b2fae2e-712c-462e-b749-d81c784f609c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.169154 Aug 22 20:03:41.907652 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1629/3417] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:41 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:42.931033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:42.931669 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:42.938946 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:42.939437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:42.939913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:42.940631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:42.941086 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:42.941509 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:43.078947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:43.087556 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:43.090296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:43.091860 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c816baf1-38b5-4e18-a22b-1239d7954ffe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.164735 Aug 22 20:03:43.092630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1789/3418] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:42 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:44.116115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:44.116691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:44.123361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:44.123881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:44.124317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:44.125018 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:44.125471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:44.125893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:44.264101 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:44.272869 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:44.274452 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:44.275626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13a82ca4-688a-473b-9a94-6627dc620392 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.163494 Aug 22 20:03:44.276225 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1630/3419] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:44 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:45.299983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:45.300823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:45.310761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:45.311388 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:45.311873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:45.312581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:45.313027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:45.313453 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:45.453881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:45.462258 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:45.463893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:45.465018 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-555b2b85-e346-4cb6-a9d6-bf696c952d00 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.169397 Aug 22 20:03:45.465577 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1790/3420] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:45 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:46.488137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:46.488779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:46.495361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:46.495885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:46.496341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:46.497553 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:46.498010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:46.498479 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:46.635466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:46.644716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:46.646268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:46.647445 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cad6ba0c-8e74-4829-8103-b5cafed93e36 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.163287 Aug 22 20:03:46.648048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1631/3421] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:46 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:03:47.670602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:47.671474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:47.677844 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:47.678327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:47.678761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:47.679457 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:47.679934 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:47.680361 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:47.818182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:47.826783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:47.828586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:47.829821 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d140bbfd-577f-4386-bede-d72554a86fa3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.163720 Aug 22 20:03:47.830349 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1791/3422] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:47 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:48.853160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:48.853923 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:48.860673 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:48.861163 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:48.861592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:48.862293 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:48.862737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:48.863155 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:49.005543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:49.014503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:49.016034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:49.017208 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4e18ddd-c90c-43fb-bb9c-d9d88736f629 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1743 microversion: 2.20 time: 0.168031 Aug 22 20:03:49.017763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1632/3423] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:48 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:03:50.042129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:50.042763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:50.049379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:50.049857 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:50.050284 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:50.050981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:50.051429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:50.051879 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:50.185157 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:50.193642 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:50.195145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:50.196351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0b7f293f-2efc-4d2a-aec7-16ec02514c39 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1743 microversion: 2.20 time: 0.158437 Aug 22 20:03:50.196909 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1792/3424] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:50 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:51.220349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:51.220985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:51.227674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:51.228347 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:51.228786 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:51.229498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:51.229944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:51.230366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:51.374056 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:51.382660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:51.384440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:51.385620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db27534b-7c0b-4ffe-8add-4d3f7da21123 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1743 microversion: 2.20 time: 0.169743 Aug 22 20:03:51.386504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1633/3425] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:51 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:52.408802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:52.409424 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:52.415988 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:52.416473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:52.416904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:52.417599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:52.418045 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:52.418461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:52.557690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:52.566958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:52.568549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:52.569686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bc5f76a3-2a2f-4cd5-a387-af0ecce9bc22 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1743 microversion: 2.20 time: 0.164920 Aug 22 20:03:52.570260 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1793/3426] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:52 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:53.593623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:53.594233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:53.601441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:53.602002 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:53.602500 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:53.603285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:53.603873 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:53.604345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:53.745726 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:53.754983 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:53.756519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:53.757683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-108e08d1-13d7-49f3-944d-b02783c9c210 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1743 microversion: 2.20 time: 0.168042 Aug 22 20:03:53.758442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1634/3427] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:53 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:54.219923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-988b7862-c03a-4fe9-b5be-bbcff73ba145 req-d4477bc7-a50d-4f37-a189-7a110eaf4344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0abc09a-44e2-4162-b11e-b6887fc66f36", "name": "network-vif-plugged", "status": "completed", "tag": "ddb352c2-1c0e-4390-8b85-3d6051d1673a"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:03:54.231138 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-988b7862-c03a-4fe9-b5be-bbcff73ba145 req-d4477bc7-a50d-4f37-a189-7a110eaf4344 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:54.232699 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-988b7862-c03a-4fe9-b5be-bbcff73ba145 req-d4477bc7-a50d-4f37-a189-7a110eaf4344 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:54.233120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-988b7862-c03a-4fe9-b5be-bbcff73ba145 req-d4477bc7-a50d-4f37-a189-7a110eaf4344 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:54.244898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-988b7862-c03a-4fe9-b5be-bbcff73ba145 req-d4477bc7-a50d-4f37-a189-7a110eaf4344 service nova] Creating event network-vif-plugged:ddb352c2-1c0e-4390-8b85-3d6051d1673a for instance c0abc09a-44e2-4162-b11e-b6887fc66f36 on hv-cinder-83538 Aug 22 20:03:54.250441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-988b7862-c03a-4fe9-b5be-bbcff73ba145 req-d4477bc7-a50d-4f37-a189-7a110eaf4344 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036124 Aug 22 20:03:54.251119 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1794/3428] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:03:54.780731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:54.782127 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:54.795013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:54.795013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:54.795013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:54.795013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:54.795538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:54.795538 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:54.964591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:54.973572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:54.975567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:54.976952 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19a4c9a6-acc6-474a-bfe7-5ca993a7c64b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1738 microversion: 2.20 time: 0.200131 Aug 22 20:03:54.977771 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1635/3429] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:54 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:56.002536 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:56.003907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:56.013513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:56.014000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:56.014697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:56.015595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:56.016100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:56.016525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:56.199503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:56.210172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:56.211991 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:56.213507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-176adb47-1714-4f7f-8c1a-b9957d6092f2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1738 microversion: 2.20 time: 0.215654 Aug 22 20:03:56.214386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1795/3430] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:55 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:57.238382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:57.239110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:57.246591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:57.247151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:57.247798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:57.248672 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:57.249940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:57.250591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:57.437298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:57.450361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:57.452433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:57.453864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-000010e3-1560-4a6a-b9a9-d21044cfc8d0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1738 microversion: 2.20 time: 0.219553 Aug 22 20:03:57.454794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1636/3431] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:57 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:58.494523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:58.495147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:58.504134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:58.504545 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:58.504995 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:58.505721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:58.506429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:58.506985 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:58.722811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:58.733861 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:58.738477 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:58.739873 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-5a437e55-83ab-4542-bd78-8108baf3ffe3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1738 microversion: 2.20 time: 0.249266 Aug 22 20:03:58.742572 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1796/3432] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:58 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1738 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:03:59.766804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:03:59.768496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:03:59.775169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:59.775689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:59.776139 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:59.776843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:03:59.777528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:03:59.778790 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:03:59.947024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:59.961012 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:59.962548 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:03:59.963775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57dd66fc-0c7e-46ff-8b3b-2acabaaf4b45 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1738 microversion: 2.20 time: 0.201562 Aug 22 20:03:59.981413 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1637/3433] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:03:59 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:00.989507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:00.990241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:00.997965 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:00.998472 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:00.999019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:00.999851 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:01.000380 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:01.000968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:01.146020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:01.156316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:01.158108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:01.159448 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4f3e09c7-f7e5-4c12-a509-cb38dc743f87 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1738 microversion: 2.20 time: 0.174006 Aug 22 20:04:01.170151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1797/3434] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:00 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:02.183606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:02.184706 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:02.196669 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:02.197197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:02.197678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:02.198432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:02.198899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:02.199337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:02.353654 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:02.363460 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:02.366176 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:02.367379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5963aead-3702-4786-9d14-509f0ddda3ef tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1738 microversion: 2.20 time: 0.188409 Aug 22 20:04:02.368280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1638/3435] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:02 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:03.397088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:03.397622 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:03.404931 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:03.405438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:03.405856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:03.406555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:03.407012 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:03.407432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:03.543797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:03.552106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:03.553616 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:03.554816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-75077bb8-ab54-4be7-9117-a61323145eaf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1738 microversion: 2.20 time: 0.161851 Aug 22 20:04:03.555381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1798/3436] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:03 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:04:04.578058 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:04.578658 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:04.581229 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=27 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:04.587215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:04.587890 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:04.588341 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:04.589129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:04.589614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:04.590046 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:04.593593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=77 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:04.811311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:04.819625 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:04.821251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:04.822518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9480f86b-2d55-46d3-96e4-25ee4c83a280 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1720 microversion: 2.20 time: 0.248718 Aug 22 20:04:04.823088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1639/3437] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:04 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:05.849153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:05.849775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:05.856814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:05.857308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:05.857745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:05.858437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:05.858887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:05.859312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:05.991313 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:06.000108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:06.001611 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:06.002779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d6e0d7e1-a675-4590-82c7-1a6116da8aac tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1720 microversion: 2.20 time: 0.157556 Aug 22 20:04:06.003341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1799/3438] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:05 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:07.027203 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:07.028447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:07.034900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:07.035384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:07.035854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:07.036556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:07.037006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:07.037430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:07.176498 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:07.187238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:07.188773 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:07.189936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aaf49dcb-0eb9-4541-9156-42c06926dc79 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1663 microversion: 2.20 time: 0.167705 Aug 22 20:04:07.190513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1640/3439] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:07 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:07.213994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6ccdb9c8-a9c3-4e3d-871e-49c2864a203a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8893749-a8be-4461-b4f9-9964ff4cbbf3"}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:04:07.216954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6ccdb9c8-a9c3-4e3d-871e-49c2864a203a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:07.219366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=29 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:07.225735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ccdb9c8-a9c3-4e3d-871e-49c2864a203a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:07.226222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ccdb9c8-a9c3-4e3d-871e-49c2864a203a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:07.226912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ccdb9c8-a9c3-4e3d-871e-49c2864a203a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:07.227610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ccdb9c8-a9c3-4e3d-871e-49c2864a203a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:07.228085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ccdb9c8-a9c3-4e3d-871e-49c2864a203a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:07.228505 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6ccdb9c8-a9c3-4e3d-871e-49c2864a203a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:07.231186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:07.514945 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6ccdb9c8-a9c3-4e3d-871e-49c2864a203a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304820 Aug 22 20:04:07.515550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1800/3440] 10.222.0.61 () {62 vars in 1364 bytes} [Mon Aug 22 20:04:07 2022] POST /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 20:04:07.638343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:04:07.638934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:07.644884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:07.645368 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:07.645802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:07.646508 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:07.646960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:07.647382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:07.688943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120640) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 20:04:07.755129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-790a1843-949e-431a-81e3-c9fccff52335 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/action" status: 202 len: 0 microversion: 2.20 time: 0.121077 Aug 22 20:04:07.755648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1641/3441] 10.222.0.61 () {62 vars in 1319 bytes} [Mon Aug 22 20:04:07 2022] POST /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 20:04:07.764060 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:07.764678 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:07.771372 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:07.771911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:07.772354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:07.773055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:07.773506 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:07.773929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:07.910700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:07.924799 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:07.927637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:07.928868 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d69c360b-f1ed-4564-9602-07b56144b519 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1749 microversion: 2.20 time: 0.168883 Aug 22 20:04:07.929442 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1801/3442] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:07 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:08.279946 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9a702791-2adc-4ae8-8f4a-c2caa6b7d107 req-78f8b1dd-8ec1-458c-82e7-8a9fa1b2d738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0abc09a-44e2-4162-b11e-b6887fc66f36", "name": "network-vif-unplugged", "status": "completed", "tag": "ddb352c2-1c0e-4390-8b85-3d6051d1673a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:04:08.292304 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9a702791-2adc-4ae8-8f4a-c2caa6b7d107 req-78f8b1dd-8ec1-458c-82e7-8a9fa1b2d738 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:08.293848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9a702791-2adc-4ae8-8f4a-c2caa6b7d107 req-78f8b1dd-8ec1-458c-82e7-8a9fa1b2d738 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:08.295808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9a702791-2adc-4ae8-8f4a-c2caa6b7d107 req-78f8b1dd-8ec1-458c-82e7-8a9fa1b2d738 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:08.306522 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_external_events [req-9a702791-2adc-4ae8-8f4a-c2caa6b7d107 req-78f8b1dd-8ec1-458c-82e7-8a9fa1b2d738 service nova] Unable to find a host for instance c0abc09a-44e2-4162-b11e-b6887fc66f36. Dropping event network-vif-unplugged {{(pid=120640) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 20:04:08.307571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9a702791-2adc-4ae8-8f4a-c2caa6b7d107 req-78f8b1dd-8ec1-458c-82e7-8a9fa1b2d738 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032365 Aug 22 20:04:08.308392 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1642/3443] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 22 20:04:08.952203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:08.952814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:08.959287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:08.959808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:08.960248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:08.960949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:08.961391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:08.961816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:09.095660 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:09.104178 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:09.105703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:09.107348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-69d22966-78c9-41a9-9275-3c9ddd2ca8dc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1751 microversion: 2.20 time: 0.159399 Aug 22 20:04:09.107949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1802/3444] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:08 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:10.130874 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:10.131477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:10.138741 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:10.139477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:10.139933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:10.140634 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:10.141083 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:10.141503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:10.384110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:10.394205 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:10.395762 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:10.396950 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b24e8887-4184-4414-80f7-ba7634b14d1d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.270314 Aug 22 20:04:10.397565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1643/3445] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:10 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:11.420791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:11.422130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:11.428855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:11.429337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:11.429769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:11.430470 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:11.430916 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:11.431333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:11.571389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:11.581464 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:11.583465 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:11.585117 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cf424556-6493-4df0-b54e-5a68fbecb0d3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.168684 Aug 22 20:04:11.600026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1803/3446] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:11 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:12.608944 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:12.609676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:12.616296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:12.616900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:12.617340 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:12.618050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:12.618502 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:12.618927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:12.768877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:12.779534 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:12.781296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:12.782565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d1e058c2-150d-4dcd-be98-eb7938dd1946 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.178009 Aug 22 20:04:12.783130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1644/3447] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:12 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:13.806106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:13.806875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:13.814371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:13.814863 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:13.815303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:13.816052 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:13.816504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:13.816928 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:13.966783 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:13.977434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:13.979129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:13.981865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-862b22e3-c6d5-4470-a234-ee77fd16aa26 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.178303 Aug 22 20:04:13.990499 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1804/3448] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:13 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:15.006434 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:15.007193 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:15.019424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:15.019969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:15.020436 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:15.021168 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:15.021629 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:15.022055 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:15.175735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:15.185679 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:15.187621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:15.189644 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b85435bc-ced5-4d6e-aaa7-d47706688af0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.187171 Aug 22 20:04:15.190461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1645/3449] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:15 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:16.215148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:16.215929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:16.223350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:16.224065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:16.224676 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:16.225707 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:16.226396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:16.227063 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:16.377023 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:16.386467 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:16.388083 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:16.389279 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-451a20d9-7f80-46de-ae32-285ac99752ee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.179577 Aug 22 20:04:16.389875 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1805/3450] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:16 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:04:17.413034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:17.413699 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:17.421888 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:17.422751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:17.423328 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:17.424277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:17.424737 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:17.425165 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:17.564075 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:17.573843 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:17.576070 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:17.577513 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ef6b635d-0da8-47f1-9c8c-624d11a10dd6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.168531 Aug 22 20:04:17.578231 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1646/3451] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:17 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:04:18.600226 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:18.600940 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:18.608726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:18.609217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:18.609682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:18.610456 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:18.610936 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:18.611363 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:18.745996 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:18.754738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:18.756269 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:18.757427 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-185a9dc3-5478-4fd3-b81d-968f0b100605 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.161253 Aug 22 20:04:18.757993 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1806/3452] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:18 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:19.780142 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:19.780744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:19.786779 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:19.787264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:19.787751 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:19.788447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:19.788904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:19.789331 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:19.916985 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:19.926219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:19.927796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:19.928986 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c14ee728-d775-4a3f-9e34-6adaa8d24de5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.152795 Aug 22 20:04:19.929549 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1647/3453] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:19 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:20.952585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:20.953204 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:20.959908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:20.960394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:20.960835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:20.961531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:20.961989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:20.962416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:21.094128 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:21.102772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:21.104329 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:21.106211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9455c56f-8383-48c5-8c78-331e200aaf7a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.157148 Aug 22 20:04:21.106724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1807/3454] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:20 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:22.129982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:22.130619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:22.137848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:22.138337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:22.138774 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:22.139472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:22.139951 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:22.140374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:22.277778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:22.286631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:22.288194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:22.289362 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1dbd4c03-ad49-4565-9aeb-31734b7fed5a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.163258 Aug 22 20:04:22.289917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1648/3455] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:22 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:04:23.312094 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:23.312682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:23.319265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:23.319781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:23.320210 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:23.320895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:23.321338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:23.321757 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:23.452811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:23.462697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:23.464211 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:23.465531 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-530f7c0f-9cfa-4286-be02-790a2fc40a21 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.157180 Aug 22 20:04:23.466106 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1808/3456] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:23 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:24.489458 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:24.490062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:24.496594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:24.497072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:24.497504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:24.498188 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:24.498635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:24.499081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:24.637725 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:24.649416 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:24.650963 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:24.652152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6078bf19-c20b-4455-90da-63f714e1c5b9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.166479 Aug 22 20:04:24.652704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1649/3457] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:24 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:25.675044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:25.675679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:25.682041 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:25.682514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:25.682950 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:25.684172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:25.684612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:25.685026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:25.815702 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:25.824502 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:25.826007 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:25.827434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9457d911-18de-4b7e-bef6-12e682ca4250 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.156347 Aug 22 20:04:25.828029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1809/3458] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:25 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:26.850524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:26.851130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:26.857822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:26.858300 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:26.858733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:26.859421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:26.859903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:26.860323 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:26.992010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:27.001312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:27.002819 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:27.004026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ac99c801-8342-4033-b6ff-b7820a5b7cd2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.157591 Aug 22 20:04:27.004589 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1650/3459] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:26 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:28.027001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:28.027610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:28.033671 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:28.034151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:28.034584 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:28.035293 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:28.035763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:28.036191 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:28.172053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:28.181021 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:28.182513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:28.184310 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e78e0c5e-b715-43a1-831e-7dadac0f7d1b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.161859 Aug 22 20:04:28.184874 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1810/3460] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:28 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:29.015829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:04:29.016428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:29.022639 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:29.023116 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:29.023543 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:29.024249 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:29.024694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:29.025108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:29.047430 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lazy-loading 'flavor' on Instance uuid 720e548c-fdb5-49f9-93cc-ff4aa7864b0d {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 20:04:29.118940 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [6e01b834-b31b-4e90-bf2b-0075d5fc52c3] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 20:04:29.206646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:29.207243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:29.213829 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:29.215432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:29.215432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:29.216233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:29.216434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:29.216884 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:29.354966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:29.364826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:29.366337 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:29.367769 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6141a094-b27a-49d8-ac85-4e5b37ac176f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.164920 Aug 22 20:04:29.368444 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1811/3461] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:29 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:04:30.125811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [6e01b834-b31b-4e90-bf2b-0075d5fc52c3] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 52116. Aug 22 20:04:30.129290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-52720a5e-8703-4ccc-b2b9-87a5eb12051a tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "POST /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d/action" status: 202 len: 0 microversion: 2.1 time: 1.117489 Aug 22 20:04:30.129904 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1651/3462] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 20:04:29 2022] POST /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d/action => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 20:04:30.138051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:30.138665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:30.144847 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:30.145336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:30.145811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:30.146761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:30.147241 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:30.147690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:30.284912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:30.292635 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-443335d1-6e05-4a3d-b6dd-cfa94d932fec tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.158340 Aug 22 20:04:30.293194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1812/3463] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:30 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:30.392621 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:30.393308 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:30.399342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:30.399854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:30.400286 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:30.400974 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:30.402503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:30.402503 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:30.534518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:30.543152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:30.544667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:30.545817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-577562ba-5f09-4b11-924a-494ff490a38f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.157569 Aug 22 20:04:30.546370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1652/3464] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:30 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:31.314034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:31.314646 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:31.321149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:31.321637 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:31.322070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:31.322759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:31.323212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:31.324282 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:31.471410 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:31.479999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eee2bec9-c031-4bd4-a183-97e433cd566b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.169804 Aug 22 20:04:31.480586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1813/3465] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:31 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:31.569128 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:31.569712 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:31.577080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:31.577563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:31.577990 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:31.578677 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:31.579121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:31.579540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:31.595844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:31.713594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:31.722896 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:31.724461 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:31.725635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6f22416-0fa0-4d7e-a10b-b71fb1ddc056 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.160457 Aug 22 20:04:31.726196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1653/3466] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:31 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:32.501747 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:32.502364 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:32.509048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:32.509535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:32.509976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:32.510703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:32.511189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:32.511615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:32.515532 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:32.644474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:32.652148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8e9e3998-ed86-434e-9e9c-c0df8c57df49 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.154246 Aug 22 20:04:32.652730 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1814/3467] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:32 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:32.750067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:32.750691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:32.757190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:32.757667 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:32.758097 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:32.758785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:32.759230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:32.759678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:32.888681 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:32.897428 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:32.898929 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:32.900112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b271f58-2adf-407d-8ea0-6c2db290fc99 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.154549 Aug 22 20:04:32.900675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1654/3468] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:32 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:33.673754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:33.674376 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:33.681120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:33.681620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:33.682059 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:33.682767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:33.683758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:33.684186 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:33.822473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:33.831118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8e01e220-82a0-4a83-b6e8-9b8e08826278 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.161263 Aug 22 20:04:33.831697 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1815/3469] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:33 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:33.922367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:33.922981 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:33.929567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:33.930050 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:33.930488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:33.931182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:33.931635 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:33.932081 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:34.057680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:04:34.058570 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 20:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:04:34.065106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:34.073830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:34.075334 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:34.076784 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71e4e4e3-0c01-4ca6-b235-6eea529327d7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.158048 Aug 22 20:04:34.077338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1655/3470] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:33 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:34.852135 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:34.852776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:34.859720 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:34.860203 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:34.860640 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:34.861326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:34.861775 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:34.862197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:34.990275 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:34.999110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d3a7f32a-6535-4a96-9620-7171c354c15b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.150787 Aug 22 20:04:35.000000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1816/3471] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:34 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:35.098832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:35.099443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:35.101759 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:35.107810 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:35.108215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:35.108664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:35.109367 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:35.109824 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:35.110255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:35.241720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:35.250246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:35.251781 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:35.252920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5d5a009-1298-4792-a6b6-f33319f40851 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.158117 Aug 22 20:04:35.253483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1656/3472] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:35 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:36.021218 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:36.021815 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:36.028272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:36.028754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:36.029198 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:36.029886 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:36.030336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:36.030758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:36.162776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:36.170583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-99e1157d-aeba-42ee-86d9-6760944891d1 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.153214 Aug 22 20:04:36.171144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1817/3473] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:36 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:36.275794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:36.276337 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:36.282680 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:36.283178 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:36.283603 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:36.284324 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:36.284775 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:36.285196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:36.436077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-756ae5c5-9a21-4b8a-a965-b557b8b9e0e5 req-2a760386-69bc-4fbd-accb-4eafcdaa210c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0abc09a-44e2-4162-b11e-b6887fc66f36", "name": "network-vif-plugged", "status": "completed", "tag": "ddb352c2-1c0e-4390-8b85-3d6051d1673a"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:04:36.446290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-756ae5c5-9a21-4b8a-a965-b557b8b9e0e5 req-2a760386-69bc-4fbd-accb-4eafcdaa210c service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:36.446871 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-756ae5c5-9a21-4b8a-a965-b557b8b9e0e5 req-2a760386-69bc-4fbd-accb-4eafcdaa210c service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:36.447192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-756ae5c5-9a21-4b8a-a965-b557b8b9e0e5 req-2a760386-69bc-4fbd-accb-4eafcdaa210c service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:36.460076 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-756ae5c5-9a21-4b8a-a965-b557b8b9e0e5 req-2a760386-69bc-4fbd-accb-4eafcdaa210c service nova] Creating event network-vif-plugged:ddb352c2-1c0e-4390-8b85-3d6051d1673a for instance c0abc09a-44e2-4162-b11e-b6887fc66f36 on hv-cinder-83538 Aug 22 20:04:36.465501 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-756ae5c5-9a21-4b8a-a965-b557b8b9e0e5 req-2a760386-69bc-4fbd-accb-4eafcdaa210c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033623 Aug 22 20:04:36.466397 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1818/3474] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 20:04:36.673572 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:36.682210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:36.683763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:36.684916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-23445dca-7160-4029-87dd-d822356e1478 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.413206 Aug 22 20:04:36.685474 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1657/3475] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:36 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:37.193609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:37.194316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:37.200487 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:37.200967 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:37.201665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:37.202352 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:37.202804 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:37.203228 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:37.332972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:37.341332 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-81aef996-758d-4914-9a9f-e3d8e1576e60 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.152512 Aug 22 20:04:37.341902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1819/3476] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:37 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:37.712802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:37.713411 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:37.720613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:37.721183 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:37.721670 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:37.722426 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:37.722928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:37.723399 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:37.856008 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:37.864619 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:37.866114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:37.867266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-194649f2-33bd-4d72-9df8-344a11658d72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.163481 Aug 22 20:04:37.867848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1658/3477] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:37 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:38.362414 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:38.362973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:38.365455 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=40 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:38.371268 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:38.371773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:38.372208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:38.372904 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:38.373355 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:38.373777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:38.505517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:38.513266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-666441a5-f41a-44bc-adfa-e3d6e67aeb07 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.154792 Aug 22 20:04:38.513832 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1820/3478] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:38 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:38.890126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:38.890749 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:38.897295 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:38.897782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:38.898220 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:38.898911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:38.899360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:38.899838 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:39.027972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:39.036710 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:39.038215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:39.039375 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0315c05-2509-480a-a591-1a033913eb33 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1807 microversion: 2.20 time: 0.153252 Aug 22 20:04:39.039959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1659/3479] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:38 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:39.534013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:39.534614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:39.541194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:39.541677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:39.542116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:39.542806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:39.543278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:39.543754 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:39.679512 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:39.689287 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e48ad020-8e0a-441b-b4a3-1553d90fb21e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.158911 Aug 22 20:04:39.689784 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1821/3480] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:39 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:40.062555 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:40.063140 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:40.069504 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:40.069989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:40.070444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:40.071118 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:40.071569 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:40.072027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:40.201085 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:40.209913 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:40.211403 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:40.212576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea660d44-3dfd-4c27-b373-534c08715269 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1794 microversion: 2.20 time: 0.154123 Aug 22 20:04:40.213129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1660/3481] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:04:40 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:04:40.711064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:40.711703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:40.718749 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:40.719231 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:40.719688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:40.720383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:40.720837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:40.721261 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:40.856132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:40.863824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-317aedfb-6ff1-4f44-a0fe-df62cb08cd79 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.156530 Aug 22 20:04:40.864383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1822/3482] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:40 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:41.884711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:41.885305 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:41.892525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:41.893006 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:41.893437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:41.894281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:41.894575 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:41.894998 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:42.028585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:42.036330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1c3b16f7-2009-43fb-a725-5c60626c70b2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.155446 Aug 22 20:04:42.036906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1661/3483] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:41 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:43.057416 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:43.058582 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:43.066046 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:43.066538 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:43.066979 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:43.067807 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:43.068256 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:43.068674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:43.200706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:43.208722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-179643b9-5319-4a4f-ad13-95af716185a7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.155166 Aug 22 20:04:43.209387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1823/3484] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:43 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:44.230846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:44.231515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:44.239108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:44.239593 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:44.240060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:44.240796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:44.241248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:44.241671 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:44.380035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:44.389662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-304f0e69-28bc-4519-a916-f50cb1247fff tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.163823 Aug 22 20:04:44.390252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1662/3485] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:44 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:45.411665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:45.412225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:45.418665 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:45.419147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:45.419583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:45.420295 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:45.420745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:45.421171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:45.551691 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:45.559911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f147eb08-4134-452f-a8ce-9e9e11f8d5f3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.152400 Aug 22 20:04:45.560484 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1824/3486] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:45 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:46.582648 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:46.583252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:46.590169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:46.590638 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:46.591062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:46.591772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:46.592216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:46.592630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:46.724807 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:46.733059 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10f093e3-9eff-492f-b0da-fb8ab7b31643 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.154209 Aug 22 20:04:46.733620 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1663/3487] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:46 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:47.753743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:47.754356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:47.760808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:47.761298 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:47.761734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:47.762433 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:47.762891 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:47.763319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:47.902077 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:47.910031 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c694aefc-9b99-476b-9f4d-328ce372e7b3 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.160063 Aug 22 20:04:47.910597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1825/3488] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:47 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:48.931892 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:48.933062 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:48.939115 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:48.939601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:48.940080 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:48.940800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:48.941255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:48.941683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:49.070562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:49.078558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34c99bbd-5e4c-44e8-9c74-8e4d4f12aa38 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1511 microversion: 2.1 time: 0.150773 Aug 22 20:04:49.079125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1664/3489] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:48 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:49.098583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:04:49.099177 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:49.106069 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:49.106548 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:49.106980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:49.107686 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:49.108144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:49.108571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:49.150318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120639) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 20:04:49.215466 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR oslo.messaging._drivers.impl_rabbit [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [de3041a1-4d92-47d0-b14e-d1766a114ea9] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 20:04:50.222589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [de3041a1-4d92-47d0-b14e-d1766a114ea9] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 52216. Aug 22 20:04:50.226205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-780b459f-0803-4b85-ba69-954e67edd90b tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "POST /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d/action" status: 202 len: 0 microversion: 2.1 time: 1.131590 Aug 22 20:04:50.227034 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1826/3490] 10.222.0.61 () {60 vars in 1278 bytes} [Mon Aug 22 20:04:49 2022] POST /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d/action => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 20:04:50.235065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:50.235705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:50.242376 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:50.242867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:50.243303 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:50.244048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:50.244497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:50.245412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:50.394842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:50.403540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea73cab5-262b-430e-8ea5-25da6f50eb93 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1519 microversion: 2.1 time: 0.172209 Aug 22 20:04:50.404106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1665/3491] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:50 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 20:04:51.427480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:51.428482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:51.439819 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:51.440626 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:51.441351 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:51.442585 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:51.443270 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:51.444019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:51.613224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:51.622762 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-714d6aff-086a-4474-974b-a534881756d9 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1519 microversion: 2.1 time: 0.201687 Aug 22 20:04:51.623745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1827/3492] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:51 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:52.512125 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-73548d44-529b-4d33-9f59-21286304c7f7 req-9c33e287-457d-4229-adb8-b7d0b7622e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720e548c-fdb5-49f9-93cc-ff4aa7864b0d", "name": "network-vif-unplugged", "status": "completed", "tag": "5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:04:52.522109 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-73548d44-529b-4d33-9f59-21286304c7f7 req-9c33e287-457d-4229-adb8-b7d0b7622e60 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:52.522592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-73548d44-529b-4d33-9f59-21286304c7f7 req-9c33e287-457d-4229-adb8-b7d0b7622e60 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:52.523082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-73548d44-529b-4d33-9f59-21286304c7f7 req-9c33e287-457d-4229-adb8-b7d0b7622e60 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:52.535431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_external_events [req-73548d44-529b-4d33-9f59-21286304c7f7 req-9c33e287-457d-4229-adb8-b7d0b7622e60 service nova] Unable to find a host for instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d. Dropping event network-vif-unplugged {{(pid=120640) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 20:04:52.536351 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-73548d44-529b-4d33-9f59-21286304c7f7 req-9c33e287-457d-4229-adb8-b7d0b7622e60 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028140 Aug 22 20:04:52.536943 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1666/3493] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 22 20:04:52.645205 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:52.645856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:52.652853 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:52.653340 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:52.653776 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:52.654601 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:52.655114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:52.655495 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:52.797075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:52.805165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-500863ab-aa35-4e76-ab8e-4f6e6e22f768 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1519 microversion: 2.1 time: 0.163883 Aug 22 20:04:52.806010 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1828/3494] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:52 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:53.827238 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:53.827875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:53.834253 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:53.834734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:53.835170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:53.835899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:53.836361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:53.836785 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:53.967011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:53.974720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86d1efb7-b3a4-4b8e-8f8e-63a01d0bdf81 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1519 microversion: 2.1 time: 0.152145 Aug 22 20:04:53.975280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1667/3495] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:53 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:54.996525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:54.997195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:55.003976 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:55.005071 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:55.005511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:55.006227 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:55.006677 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:55.007105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:55.147367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:55.155954 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-136b684c-81e4-4961-920e-397403626ef2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1519 microversion: 2.1 time: 0.163838 Aug 22 20:04:55.156529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1829/3496] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:54 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:56.180152 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:56.180763 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:56.187857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:56.188345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:56.188780 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:56.189478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:56.189928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:56.190349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:56.366472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:56.375975 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15ff24d8-4b41-437e-8d98-ca8331ac66ab tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.199441 Aug 22 20:04:56.376689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1668/3497] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:56 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:57.408257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:57.408826 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:57.415290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:57.415808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:57.416232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:57.417445 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:57.417893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:57.418321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:57.434212 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:57.566628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:57.574980 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6bbaa3d6-94c2-4262-a70d-9dd85508a708 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.170615 Aug 22 20:04:57.575555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1830/3498] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:57 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:58.597129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:58.597880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:58.604088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:58.604576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:58.605011 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:58.605715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:58.606195 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:58.606614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:58.801744 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:58.809947 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f913e1e8-6e0c-4cae-b126-3f3ef2695e2d tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.216985 Aug 22 20:04:58.810524 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1669/3499] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:58 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:04:59.831168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:04:59.831840 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:04:59.838235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:59.839221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:59.839668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:59.840360 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:04:59.840812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:04:59.841235 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:04:59.970494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:04:59.978085 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-64397d9e-aa23-48d6-8eac-531e9ad8829f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.150768 Aug 22 20:04:59.978650 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1831/3500] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:04:59 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:00.998978 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:00.999614 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:01.006327 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:01.006815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:01.007250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:01.007980 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:01.008431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:01.008853 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:01.144703 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:01.147038 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:01.153969 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-737a0654-8ebf-427d-9d57-3fd6f5d5d58e tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.159359 Aug 22 20:05:01.154554 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1670/3501] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:00 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:02.175460 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:02.176102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:02.182623 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:02.183110 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:02.183555 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:02.184278 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:02.184734 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:02.185165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:02.311839 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:02.319438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a2ec0986-a0b2-4f4e-897d-d47c84353022 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.147820 Aug 22 20:05:02.320030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1832/3502] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:02 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:03.341089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:03.341689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:03.348306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:03.348794 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:03.349232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:03.349936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:03.350388 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:03.350809 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:03.498733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:03.508994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c71cf220-cfb8-4f4b-970f-4d4a8a1970bb tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.172238 Aug 22 20:05:03.509586 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1671/3503] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:03 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:04.531937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:04.532836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:04.540019 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:04.540510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:04.541125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:04.542451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:04.542902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:04.543321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:04.684808 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:04.693674 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9f9310c4-ae19-4224-a94c-0fefe1615e97 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.166637 Aug 22 20:05:04.694243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1833/3504] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:04 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:05.716695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:05.717311 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:05.719631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=32 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:05.724959 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:05.725441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:05.725872 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:05.726563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:05.727013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:05.727433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:05.864338 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:05.872468 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb1edc64-12a7-4dc0-b1dd-6f8578b2f722 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.160181 Aug 22 20:05:05.873036 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1672/3505] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:05 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:06.895290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:06.896513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:06.904030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:06.904535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:06.904973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:06.905698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:06.906148 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:06.906569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:07.038729 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:07.046596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-f0af17ae-155d-4092-9283-0b1ada26e64f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.155241 Aug 22 20:05:07.047164 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1834/3506] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:06 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:08.067772 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:08.068381 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:08.074865 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:08.075342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:08.076072 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:08.076756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:08.077200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:08.077617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:08.214302 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:08.222089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17e406c3-db22-4dcd-aa64-7367f0762c95 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.158318 Aug 22 20:05:08.222597 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1673/3507] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:08 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:08.602108 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-b19facba-9746-41f8-a5c2-3aa388ede4da req-cd9944b0-fe92-4a94-a500-02e92003c1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720e548c-fdb5-49f9-93cc-ff4aa7864b0d", "name": "network-vif-plugged", "status": "completed", "tag": "5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:05:08.607925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:08.615248 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-b19facba-9746-41f8-a5c2-3aa388ede4da req-cd9944b0-fe92-4a94-a500-02e92003c1de service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:08.616327 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-b19facba-9746-41f8-a5c2-3aa388ede4da req-cd9944b0-fe92-4a94-a500-02e92003c1de service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:08.617058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-b19facba-9746-41f8-a5c2-3aa388ede4da req-cd9944b0-fe92-4a94-a500-02e92003c1de service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:08.630280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-b19facba-9746-41f8-a5c2-3aa388ede4da req-cd9944b0-fe92-4a94-a500-02e92003c1de service nova] Creating event network-vif-plugged:5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c for instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d on hv-cinder-83538 Aug 22 20:05:08.636302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-b19facba-9746-41f8-a5c2-3aa388ede4da req-cd9944b0-fe92-4a94-a500-02e92003c1de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038468 Aug 22 20:05:08.636902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1835/3508] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:05:09.243348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:09.244001 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:09.251280 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:09.251808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:09.252241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:09.252939 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:09.253432 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:09.253811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:09.385405 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:09.393108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db678d04-b9a6-494f-a051-96cb21d96df7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.153643 Aug 22 20:05:09.393664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1674/3509] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:09 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:10.416321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:10.417620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:10.427323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:10.428610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:10.428992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:10.429735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:10.430221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:10.430643 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:10.795961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:10.804482 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a2a2d2d6-0e17-42f0-983b-e15759a7512f tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1577 microversion: 2.1 time: 0.393367 Aug 22 20:05:10.805062 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1836/3510] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:10 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1577 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:11.827041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:11.827663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:11.834141 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:11.834626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:11.835060 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:11.835793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:11.836248 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:11.836666 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:11.981196 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:11.989047 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e28c08b1-2513-4efa-8fd8-8678d3469b40 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1564 microversion: 2.1 time: 0.166629 Aug 22 20:05:11.989708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1675/3511] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:05:11 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:44.214434 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2bad1674-f62c-47f0-9fc9-acdf022f7689 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:44.215051 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2bad1674-f62c-47f0-9fc9-acdf022f7689 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:44.217250 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=3 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:44.217911 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=35 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:44.223981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bad1674-f62c-47f0-9fc9-acdf022f7689 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:44.224479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bad1674-f62c-47f0-9fc9-acdf022f7689 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:44.224923 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bad1674-f62c-47f0-9fc9-acdf022f7689 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:44.225632 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bad1674-f62c-47f0-9fc9-acdf022f7689 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:44.226089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bad1674-f62c-47f0-9fc9-acdf022f7689 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:44.226519 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2bad1674-f62c-47f0-9fc9-acdf022f7689 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:44.256956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2bad1674-f62c-47f0-9fc9-acdf022f7689 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments/a8893749-a8be-4461-b4f9-9964ff4cbbf3" status: 200 len: 194 microversion: 2.20 time: 0.046453 Aug 22 20:05:44.257554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1837/3512] 10.222.0.61 () {60 vars in 1454 bytes} [Mon Aug 22 20:05:44 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments/a8893749-a8be-4461-b4f9-9964ff4cbbf3 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 20:05:44.326166 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:44.326729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:44.328906 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=7 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:44.329715 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=31 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:44.335987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:44.336473 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:44.336911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:44.337617 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:44.338071 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:44.338497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:44.420870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lazy-loading 'services' on Instance uuid c0abc09a-44e2-4162-b11e-b6887fc66f36 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 20:05:44.492627 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e77f0826-0d3c-42ce-8af9-ed11f11c4249 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments/a8893749-a8be-4461-b4f9-9964ff4cbbf3" status: 202 len: 0 microversion: 2.20 time: 0.171263 Aug 22 20:05:44.493210 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1676/3513] 10.222.0.61 () {60 vars in 1457 bytes} [Mon Aug 22 20:05:44 2022] DELETE /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments/a8893749-a8be-4461-b4f9-9964ff4cbbf3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 20:05:44.501977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c02754ed-cb43-4c3b-9b22-54aab00b6aee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:44.504176 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c02754ed-cb43-4c3b-9b22-54aab00b6aee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:44.510600 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c02754ed-cb43-4c3b-9b22-54aab00b6aee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:44.511088 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c02754ed-cb43-4c3b-9b22-54aab00b6aee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:44.511522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c02754ed-cb43-4c3b-9b22-54aab00b6aee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:44.512302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c02754ed-cb43-4c3b-9b22-54aab00b6aee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:44.512721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c02754ed-cb43-4c3b-9b22-54aab00b6aee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:44.513208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c02754ed-cb43-4c3b-9b22-54aab00b6aee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:44.543382 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c02754ed-cb43-4c3b-9b22-54aab00b6aee tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045119 Aug 22 20:05:44.543872 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1838/3514] 10.222.0.61 () {60 vars in 1343 bytes} [Mon Aug 22 20:05:44 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 20:05:45.558449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-78630c62-751d-4ad3-a18a-d9c31673dba0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:45.561449 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-78630c62-751d-4ad3-a18a-d9c31673dba0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:45.568490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78630c62-751d-4ad3-a18a-d9c31673dba0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:45.568938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78630c62-751d-4ad3-a18a-d9c31673dba0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:45.569559 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78630c62-751d-4ad3-a18a-d9c31673dba0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:45.570268 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78630c62-751d-4ad3-a18a-d9c31673dba0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:45.570721 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78630c62-751d-4ad3-a18a-d9c31673dba0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:45.571147 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-78630c62-751d-4ad3-a18a-d9c31673dba0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:45.601623 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-78630c62-751d-4ad3-a18a-d9c31673dba0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048820 Aug 22 20:05:45.602214 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1677/3515] 10.222.0.61 () {60 vars in 1343 bytes} [Mon Aug 22 20:05:45 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:05:45.666305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:45.666917 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:45.673479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:45.673970 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:45.674413 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:45.675116 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:45.675571 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:45.676070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:45.703121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Going to try to terminate instance {{(pid=120639) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 20:05:45.786609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8b5a3300-8ef9-49ad-8447-bb947359779f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 204 len: 0 microversion: 2.20 time: 0.123672 Aug 22 20:05:45.787587 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1839/3516] 10.222.0.61 () {60 vars in 1280 bytes} [Mon Aug 22 20:05:45 2022] DELETE /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 20:05:45.796967 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:45.797911 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:45.804233 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:45.804724 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:45.805159 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:45.805857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:45.806859 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:45.807283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:45.951082 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:45.959518 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:45.961088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:45.962318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e34fd51-bc25-4768-98a3-ba8ae6d33281 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.169425 Aug 22 20:05:45.962879 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1678/3517] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:45 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:05:46.985767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:46.986490 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:46.992989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:46.993469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:46.993908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:46.994595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:46.995044 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:46.995452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:47.125134 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:47.133703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:47.135878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:47.137054 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8480ca2f-487d-4e8a-a366-2dfa457df935 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.155570 Aug 22 20:05:47.137620 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1840/3518] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:46 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:05:48.160289 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:48.160891 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:48.168532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:48.169158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:48.169676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:48.170422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:48.170876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:48.171292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:48.421568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:48.429609 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:48.431106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:48.432282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92e249d2-c6c7-4ba7-9671-f0d3fb9f13c2 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 200 len: 1722 microversion: 2.20 time: 0.276066 Aug 22 20:05:48.432830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1679/3519] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:48 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:05:48.626440 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-818e28e8-684f-4e08-aa0f-a47a9f74edd5 req-5a53eb00-07e8-47ed-bda9-e06c3b5968e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0abc09a-44e2-4162-b11e-b6887fc66f36", "name": "network-vif-deleted", "tag": "ddb352c2-1c0e-4390-8b85-3d6051d1673a"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:05:48.638458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-818e28e8-684f-4e08-aa0f-a47a9f74edd5 req-5a53eb00-07e8-47ed-bda9-e06c3b5968e8 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:48.638986 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-818e28e8-684f-4e08-aa0f-a47a9f74edd5 req-5a53eb00-07e8-47ed-bda9-e06c3b5968e8 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:48.639348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-818e28e8-684f-4e08-aa0f-a47a9f74edd5 req-5a53eb00-07e8-47ed-bda9-e06c3b5968e8 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:48.652492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-818e28e8-684f-4e08-aa0f-a47a9f74edd5 req-5a53eb00-07e8-47ed-bda9-e06c3b5968e8 service nova] Creating event network-vif-deleted:ddb352c2-1c0e-4390-8b85-3d6051d1673a for instance c0abc09a-44e2-4162-b11e-b6887fc66f36 on hv-cinder-83538 Aug 22 20:05:48.658685 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-818e28e8-684f-4e08-aa0f-a47a9f74edd5 req-5a53eb00-07e8-47ed-bda9-e06c3b5968e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035926 Aug 22 20:05:48.659549 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1841/3520] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 20:05:49.456301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:49.457106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:49.466391 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:49.466817 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:49.467574 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:49.468847 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:49.469732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:49.470787 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:49.497435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] HTTP exception thrown: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Request method failure captured: Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 HTTP/1.1 Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA-C5V_Gsp4bH8kfUXmgEs63SBY1yxpohpzuKV9Yb8mBzTx8OCdvv8VVekmtmgFJuOqjW3n9KIDVaKWDd1_Cohk6brQIzhpFY0pc70fjWo6Q_gEhk7NzXJegeDCZYEqT8GZyvuhtSnDNu1lbdP6oS-RVPUbJGCV59TkXsfFA2Y6ZEmD8 Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 20:05:49.500550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}] Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: e0dc5256349a442db02b6e5584872356 Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:05:49.502032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': 'c0abc09a-44e2-4162-b11e-b6887fc66f36'} Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:05:49.502776 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:05:49.504035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:05:49.506832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Returning 404 to user: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:05:49.506832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2218c0ac-bf2d-42f6-a4c3-395c3448e553 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 404 len: 111 microversion: 2.20 time: 0.050350 Aug 22 20:05:49.506832 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1680/3521] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:49 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 20:05:49.514053 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6f122684-cb82-45cc-975a-b44d3bab3544 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '.version_select at 0x7f66df7cf820>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:49.537399 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6f122684-cb82-45cc-975a-b44d3bab3544 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485125352" status: 204 len: 0 microversion: 2.20 time: 0.028356 Aug 22 20:05:49.538089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1842/3522] 10.222.0.61 () {60 vars in 1259 bytes} [Mon Aug 22 20:05:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485125352 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 22 20:05:50.196099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-33715b67-e364-40c9-9d0f-345b56f7d723 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'create', calling method: .version_select at 0x7f66e7e06940>, body: {"keypair": {"name": "tempest-keypair-651097318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNhuz63LGmQmz72X7CpIuYk2GSDvgn87zkHEoVJB4+xcd6qjXRh1o6J1GfTMKly4iPOkX1KxphFLi/gaxEjaaE7sb8CI0wFMEiNkPSJSztzs34lI0NHaK7gxpoaci/Gtg=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:05:50.212215 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-33715b67-e364-40c9-9d0f-345b56f7d723 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Getting quotas for project 548a965fed81436fa0440d4c4db00e2c. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 20:05:50.216170 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-33715b67-e364-40c9-9d0f-345b56f7d723 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Getting quotas for user e0dc5256349a442db02b6e5584872356 and project 548a965fed81436fa0440d4c4db00e2c. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 20:05:50.237894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-33715b67-e364-40c9-9d0f-345b56f7d723 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045636 Aug 22 20:05:50.238485 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1681/3523] 10.222.0.61 () {62 vars in 1200 bytes} [Mon Aug 22 20:05:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 22 20:05:51.483303 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-970990780", "imageRef": "3bbaa833-c7c5-48df-a2f2-4869b4c2048f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d830740-8f11-4d20-9890-977a8dc6156a"}], "security_groups": [{"name": "tempest-securitygroup--1177711174"}], "key_name": "tempest-keypair-651097318", "user_data": "}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:05:51.584684 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.network.neutron [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] validate_networks() for [('5d830740-8f11-4d20-9890-977a8dc6156a', None, None, None, None, None)] {{(pid=120639) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 20:05:51.945454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Flavor limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 20:05:51.945887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Image limits 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 20:05:51.946368 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Flavor pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 20:05:51.947411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Image pref 0:0:0 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 20:05:51.948121 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.virt.hardware [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120639) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 20:05:51.957907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:51.958627 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:51.959240 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:51.960162 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:51.960789 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:51.961385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:51.979812 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Getting quotas for project 548a965fed81436fa0440d4c4db00e2c. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 20:05:51.983854 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.quota [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Getting quotas for user e0dc5256349a442db02b6e5584872356 and project 548a965fed81436fa0440d4c4db00e2c. Resources: {'instances', 'cores', 'ram'} {{(pid=120639) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 20:05:51.995058 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Going to run 1 instances... {{(pid=120639) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 20:05:51.997488 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbaa833-c7c5-48df-a2f2-4869b4c2048f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120639) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 20:05:52.044479 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-046e638a-1928-4b6c-8094-6f40f135adc9 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.565890 Aug 22 20:05:52.045356 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1843/3524] 10.222.0.61 () {62 vars in 1188 bytes} [Mon Aug 22 20:05:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 20:05:52.056506 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2696c50e-6b92-46ac-816e-eb9a8731bacf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:52.057734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2696c50e-6b92-46ac-816e-eb9a8731bacf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:52.117255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2696c50e-6b92-46ac-816e-eb9a8731bacf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:52.125702 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2696c50e-6b92-46ac-816e-eb9a8731bacf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:52.127209 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2696c50e-6b92-46ac-816e-eb9a8731bacf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:52.129200 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2696c50e-6b92-46ac-816e-eb9a8731bacf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1280 microversion: 2.20 time: 0.077151 Aug 22 20:05:52.129755 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1682/3525] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:52 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:05:53.153331 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:53.154026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:53.161024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:53.161517 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:53.162154 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:53.162887 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:53.163336 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:53.163962 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:53.240515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:53.251171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:53.252981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:53.254451 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b7835457-cc6d-44f6-a528-058c956ec645 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1350 microversion: 2.20 time: 0.106307 Aug 22 20:05:53.255513 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1844/3526] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:53 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:05:54.278349 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:54.278958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:54.285695 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:54.286466 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:54.286909 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:54.287676 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:54.288133 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:54.288561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:54.513601 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:54.522219 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:54.523885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:54.525688 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f2845ab-1c7a-43d3-b65b-62385f94756c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1406 microversion: 2.20 time: 0.251688 Aug 22 20:05:54.526252 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1683/3527] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:54 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:05:54.823366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-73f77b29-0b5d-4da1-a34e-c464006067dc req-0d5d8b56-9e79-437f-a8bd-eead747ed100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f36b891-c9ec-43ae-9af8-192614a38bc7", "tag": "063e27c6-e0f6-4c23-bf61-92cea49d7dee"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:05:54.835334 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-73f77b29-0b5d-4da1-a34e-c464006067dc req-0d5d8b56-9e79-437f-a8bd-eead747ed100 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:54.836163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-73f77b29-0b5d-4da1-a34e-c464006067dc req-0d5d8b56-9e79-437f-a8bd-eead747ed100 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:54.836845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-73f77b29-0b5d-4da1-a34e-c464006067dc req-0d5d8b56-9e79-437f-a8bd-eead747ed100 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:54.848511 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-73f77b29-0b5d-4da1-a34e-c464006067dc req-0d5d8b56-9e79-437f-a8bd-eead747ed100 service nova] Creating event network-changed:063e27c6-e0f6-4c23-bf61-92cea49d7dee for instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 on hv-cinder-83538 Aug 22 20:05:54.853375 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-73f77b29-0b5d-4da1-a34e-c464006067dc req-0d5d8b56-9e79-437f-a8bd-eead747ed100 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033681 Aug 22 20:05:54.853963 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1845/3528] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:05:55.548811 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:55.549410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:55.555997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:55.556481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:55.556916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:55.557606 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:55.558057 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:55.558481 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:55.690487 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:55.699348 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:55.701148 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:55.702246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e6bc6f5-1cea-4bbc-87d5-f76e514505bf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1406 microversion: 2.20 time: 0.157311 Aug 22 20:05:55.702793 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1684/3529] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:55 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:05:56.726441 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:56.727065 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:56.733895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:56.734385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:56.734822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:56.735521 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:56.736006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:56.736435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:56.875900 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:56.885435 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:56.886984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:56.888165 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-b75f938d-131a-4b47-8937-1d8f0bf28ea8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1406 microversion: 2.20 time: 0.166702 Aug 22 20:05:56.888737 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1846/3530] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:56 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:05:57.910945 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:57.911689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:57.918855 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:57.919453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:57.919948 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:57.920717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:57.921177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:57.921632 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:58.109960 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:58.119448 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:58.120997 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:58.122121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e3e9f45-ca0b-431c-8732-b24e9bc87d30 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1406 microversion: 2.20 time: 0.215376 Aug 22 20:05:58.122687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1685/3531] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:57 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:05:59.143612 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:05:59.144271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:05:59.151232 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:59.151742 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:59.152172 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:59.152856 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:05:59.153301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:05:59.153718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:05:59.283721 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:59.292322 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:59.293813 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:05:59.294912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-49aa9f3f-64f2-40e5-827c-f3431d74d3f5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1406 microversion: 2.20 time: 0.155277 Aug 22 20:05:59.295462 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1847/3532] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:05:59 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:06:00.316241 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:00.316854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:00.323377 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:00.323893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:00.324332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:00.325288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:00.325745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:00.326175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:00.453801 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:00.462336 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:00.463881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:00.465048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3379175-09a5-4981-a89a-6eaabe22b2d6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1406 microversion: 2.20 time: 0.152711 Aug 22 20:06:00.465640 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1686/3533] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:06:00 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:06:00.834750 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-34c0c73e-093d-498b-84d0-9d127ffd5ae7 req-db121345-57e0-4912-ab33-e762e1fee988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f36b891-c9ec-43ae-9af8-192614a38bc7", "name": "network-vif-plugged", "status": "completed", "tag": "063e27c6-e0f6-4c23-bf61-92cea49d7dee"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:06:00.845947 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-34c0c73e-093d-498b-84d0-9d127ffd5ae7 req-db121345-57e0-4912-ab33-e762e1fee988 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:00.846419 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-34c0c73e-093d-498b-84d0-9d127ffd5ae7 req-db121345-57e0-4912-ab33-e762e1fee988 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:00.846846 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-34c0c73e-093d-498b-84d0-9d127ffd5ae7 req-db121345-57e0-4912-ab33-e762e1fee988 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:00.858326 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-34c0c73e-093d-498b-84d0-9d127ffd5ae7 req-db121345-57e0-4912-ab33-e762e1fee988 service nova] Creating event network-vif-plugged:063e27c6-e0f6-4c23-bf61-92cea49d7dee for instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 on hv-cinder-83538 Aug 22 20:06:00.863318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-34c0c73e-093d-498b-84d0-9d127ffd5ae7 req-db121345-57e0-4912-ab33-e762e1fee988 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032194 Aug 22 20:06:00.864073 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1848/3534] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:06:01.487561 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:01.488234 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:01.495087 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:01.495566 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:01.496026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:01.496717 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:01.497167 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:01.497591 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:01.623491 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:01.631594 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:01.633157 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:01.634884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-238703ec-b744-41da-8216-8a88c02b9df0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1406 microversion: 2.20 time: 0.150702 Aug 22 20:06:01.635442 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1687/3535] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:06:01 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:06:02.654064 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=2 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:02.654806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell0:SELECT=6 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:02.659192 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:02.659918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:02.667366 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:02.667806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:02.668238 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:02.668913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:02.669354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:02.669773 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:02.798236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:02.807166 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:02.808758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:02.809855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-186a3926-b876-45ff-8184-efa78b686214 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1406 microversion: 2.20 time: 0.157191 Aug 22 20:06:02.810409 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1849/3536] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:06:02 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:06:03.831526 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:03.832283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:03.834281 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:03.839877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:03.840361 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:03.840795 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:03.841483 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:03.841931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:03.842356 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:03.967626 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:03.975815 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:03.977317 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:03.979028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cac74ed3-e931-4211-bae6-b47949131e7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1598 microversion: 2.20 time: 0.151423 Aug 22 20:06:03.979584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1688/3537] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:06:03 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:06:04.001112 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-eda1de09-10df-41df-8d78-b58f5afb07bc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:04.001630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-eda1de09-10df-41df-8d78-b58f5afb07bc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:04.007913 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eda1de09-10df-41df-8d78-b58f5afb07bc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:04.008392 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eda1de09-10df-41df-8d78-b58f5afb07bc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:04.008837 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eda1de09-10df-41df-8d78-b58f5afb07bc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:04.009520 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eda1de09-10df-41df-8d78-b58f5afb07bc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:04.009966 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eda1de09-10df-41df-8d78-b58f5afb07bc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:04.010385 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-eda1de09-10df-41df-8d78-b58f5afb07bc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:04.088999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-eda1de09-10df-41df-8d78-b58f5afb07bc tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091699 Aug 22 20:06:04.089592 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1850/3538] 10.222.0.61 () {60 vars in 1316 bytes} [Mon Aug 22 20:06:03 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 20:06:04.982542 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-0ab98fa3-037d-4ca9-898b-c427c7171a72 req-2b7fa26d-6614-4c6b-99fb-4dccba32e26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f36b891-c9ec-43ae-9af8-192614a38bc7", "tag": "063e27c6-e0f6-4c23-bf61-92cea49d7dee"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:06:04.992389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0ab98fa3-037d-4ca9-898b-c427c7171a72 req-2b7fa26d-6614-4c6b-99fb-4dccba32e26b service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:04.992871 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0ab98fa3-037d-4ca9-898b-c427c7171a72 req-2b7fa26d-6614-4c6b-99fb-4dccba32e26b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:04.993374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-0ab98fa3-037d-4ca9-898b-c427c7171a72 req-2b7fa26d-6614-4c6b-99fb-4dccba32e26b service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:05.004476 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-0ab98fa3-037d-4ca9-898b-c427c7171a72 req-2b7fa26d-6614-4c6b-99fb-4dccba32e26b service nova] Creating event network-changed:063e27c6-e0f6-4c23-bf61-92cea49d7dee for instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 on hv-cinder-83538 Aug 22 20:06:05.009917 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-0ab98fa3-037d-4ca9-898b-c427c7171a72 req-2b7fa26d-6614-4c6b-99fb-4dccba32e26b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031104 Aug 22 20:06:05.010540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1689/3539] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:06:48.342806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:06:48.343899 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:06:48.845743 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:48.846283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:48.846379 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:48.847276 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:48.852321 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ac59c5bc-ba51-41f9-92d3-6659fb82a09e req-a8efdf05-aef5-4895-83c0-9b5c2a54474d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720e548c-fdb5-49f9-93cc-ff4aa7864b0d", "tag": "5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:06:48.852546 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:48.853221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:48.854892 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:48.856168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:48.856690 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:48.857689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:48.858224 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:48.858726 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:48.865934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ac59c5bc-ba51-41f9-92d3-6659fb82a09e req-a8efdf05-aef5-4895-83c0-9b5c2a54474d service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:48.866577 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ac59c5bc-ba51-41f9-92d3-6659fb82a09e req-a8efdf05-aef5-4895-83c0-9b5c2a54474d service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:48.867154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ac59c5bc-ba51-41f9-92d3-6659fb82a09e req-a8efdf05-aef5-4895-83c0-9b5c2a54474d service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:48.881099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ac59c5bc-ba51-41f9-92d3-6659fb82a09e req-a8efdf05-aef5-4895-83c0-9b5c2a54474d service nova] Creating event network-changed:5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c for instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d on hv-cinder-83538 Aug 22 20:06:48.887422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ac59c5bc-ba51-41f9-92d3-6659fb82a09e req-a8efdf05-aef5-4895-83c0-9b5c2a54474d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043006 Aug 22 20:06:48.888367 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Going to try to terminate instance {{(pid=120639) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 20:06:48.888525 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1690/3540] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:06:48.983144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-e5318914-928a-43ab-8f2e-3ec65d5dc2f7 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "DELETE /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 204 len: 0 microversion: 2.1 time: 0.141130 Aug 22 20:06:48.984297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1851/3541] 10.222.0.61 () {58 vars in 1239 bytes} [Mon Aug 22 20:06:48 2022] DELETE /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 20:06:48.992895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:48.993161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:48.999972 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:49.000465 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:49.000902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:49.001607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:49.002064 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:49.002492 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:49.202197 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:49.210032 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d8566fa-9a2e-4cc2-81f0-920819392e87 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.221747 Aug 22 20:06:49.210599 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1691/3542] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:06:48 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:06:50.232791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:50.233480 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:50.239771 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:50.240254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:50.240680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:50.241371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:50.241809 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:50.242222 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:50.425213 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:50.432859 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6f6b2860-6778-47e4-bbfe-83632be3ec13 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1570 microversion: 2.1 time: 0.204222 Aug 22 20:06:50.434039 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1852/3543] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:06:50 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1570 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:06:51.455207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:51.455852 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:51.462571 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:51.463052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:51.463488 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:51.464212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:51.465309 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:51.465735 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:51.536301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3afb9ab5c3485287cc352735a159b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e769d7a29dbc470f9013344d9c817d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:06:51.544496 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f88f2ac-e7a3-4e04-9b3f-0e1a123108ce tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 200 len: 1383 microversion: 2.1 time: 0.093266 Aug 22 20:06:51.545350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1692/3544] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:06:51 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 1383 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:06:51.562781 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-ce809c51-5fe8-4de6-8763-d0cbcb3f96e6 req-90a6a03a-de1f-4824-8ff5-12ac438be2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720e548c-fdb5-49f9-93cc-ff4aa7864b0d", "name": "network-vif-deleted", "tag": "5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:06:51.572001 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-ce809c51-5fe8-4de6-8763-d0cbcb3f96e6 req-90a6a03a-de1f-4824-8ff5-12ac438be2db service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:51.572474 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-ce809c51-5fe8-4de6-8763-d0cbcb3f96e6 req-90a6a03a-de1f-4824-8ff5-12ac438be2db service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:51.572902 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-ce809c51-5fe8-4de6-8763-d0cbcb3f96e6 req-90a6a03a-de1f-4824-8ff5-12ac438be2db service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:51.584316 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-ce809c51-5fe8-4de6-8763-d0cbcb3f96e6 req-90a6a03a-de1f-4824-8ff5-12ac438be2db service nova] Creating event network-vif-deleted:5f2f7c78-ee8a-4a32-9ad5-60ff4756d18c for instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d on hv-cinder-83538 Aug 22 20:06:51.589055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-ce809c51-5fe8-4de6-8763-d0cbcb3f96e6 req-90a6a03a-de1f-4824-8ff5-12ac438be2db service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090993 Aug 22 20:06:51.589667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1853/3545] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:06:52.565743 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:52.566360 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] [instance: 720e548c-fdb5-49f9-93cc-ff4aa7864b0d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:06:52.572766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:52.573251 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:52.573691 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:52.574936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:06:52.575389 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:06:52.575854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:06:52.588854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] HTTP exception thrown: Instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d could not be found. Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Request method failure captured: Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d HTTP/1.1 Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA-CJto9x9_pI_bOPQka7JWTeaEINZ4E_51wpggLr6bfGyMUYFz7S3Ea9R8psL29l4zJWq_we4_UYPBCV4dHFHnEoWxkPNBfHzFED7NkglXDGG1bJm4rJJgvzIozlQ-X5IImnDTFx32daSqIsynkbQvtggBFbho7ltanSVk8nvs8Nhhk Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: e769d7a29dbc470f9013344d9c817d63 Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-TestShelveInstance-1953253265 Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 20:06:52.591009 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e769d7a29dbc470f9013344d9c817d63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e769d7a29dbc470f9013344d9c817d63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e769d7a29dbc470f9013344d9c817d63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e769d7a29dbc470f9013344d9c817d63"}]}] Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-TestShelveInstance-1953253265 Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: e769d7a29dbc470f9013344d9c817d63 Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestShelveInstance-1953253265 Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-TestShelveInstance-1953253265-project Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: ae3afb9ab5c3485287cc352735a159b8 Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-TestShelveInstance-1953253265-project Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d could not be found. Aug 22 20:06:52.592659 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '720e548c-fdb5-49f9-93cc-ff4aa7864b0d'} Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d could not be found. Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:06:52.593576 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d could not be found. Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d could not be found. Aug 22 20:06:52.595098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:06:52.596419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Returning 404 to user: Instance 720e548c-fdb5-49f9-93cc-ff4aa7864b0d could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:06:52.596419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-957880c8-690f-4042-bcba-015648c6d3f2 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d" status: 404 len: 111 microversion: 2.1 time: 0.030498 Aug 22 20:06:52.596419 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1693/3546] 10.222.0.61 () {58 vars in 1236 bytes} [Mon Aug 22 20:06:52 2022] GET /compute/v2.1/servers/720e548c-fdb5-49f9-93cc-ff4aa7864b0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 20:06:52.760693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6bcfe5d3-b94b-44ce-945a-45f68ec95198 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] Calling method '.version_select at 0x7f66df28c430>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:06:52.782613 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6bcfe5d3-b94b-44ce-945a-45f68ec95198 tempest-TestShelveInstance-1953253265 tempest-TestShelveInstance-1953253265-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1679733680" status: 202 len: 0 microversion: 2.1 time: 0.026151 Aug 22 20:06:52.783880 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1854/3547] 10.222.0.61 () {58 vars in 1254 bytes} [Mon Aug 22 20:06:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1679733680 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 20:07:20.004232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=8 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:20.004957 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=16 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:20.219778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f082d364-2f3e-4123-8981-afeca69d63bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:20.220278 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f082d364-2f3e-4123-8981-afeca69d63bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:20.226192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f082d364-2f3e-4123-8981-afeca69d63bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:20.226674 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f082d364-2f3e-4123-8981-afeca69d63bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:20.227110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f082d364-2f3e-4123-8981-afeca69d63bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:20.227828 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f082d364-2f3e-4123-8981-afeca69d63bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:20.228283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f082d364-2f3e-4123-8981-afeca69d63bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:20.228705 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f082d364-2f3e-4123-8981-afeca69d63bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:20.252393 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f082d364-2f3e-4123-8981-afeca69d63bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/ips" status: 200 len: 152 microversion: 2.20 time: 0.253065 Aug 22 20:07:20.252931 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1694/3548] 10.222.0.61 () {60 vars in 1289 bytes} [Mon Aug 22 20:07:19 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/ips => generated 152 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 20:07:22.013816 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:07:22.014476 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:22.016567 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:22.017221 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:22.024564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:22.025056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:22.025492 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:22.026182 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:22.026630 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:22.027050 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:22.051712 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.objects.instance [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lazy-loading 'flavor' on Instance uuid 6f36b891-c9ec-43ae-9af8-192614a38bc7 {{(pid=120639) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 20:07:22.224679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cce455ab-15c4-4652-80c9-37f1a2cc0ee7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/action" status: 202 len: 0 microversion: 2.20 time: 0.214829 Aug 22 20:07:22.225415 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1855/3549] 10.222.0.61 () {62 vars in 1319 bytes} [Mon Aug 22 20:07:22 2022] POST /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 20:07:22.233919 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:22.234533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:22.241198 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:22.241675 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:22.242024 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:22.242727 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:22.243175 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:22.243592 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:22.377061 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:22.385162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:22.386711 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:22.387915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-665f9646-d7e5-4704-98a3-32890628bd51 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.158396 Aug 22 20:07:22.388470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1695/3550] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:22 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:23.411989 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:23.412631 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:23.419610 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:23.420118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:23.420552 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:23.421244 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:23.421724 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:23.422147 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:23.549496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:23.558113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:23.559615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:23.560797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0717a7d4-539f-45ed-92f7-468e1f8c4cd4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.153672 Aug 22 20:07:23.561354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1856/3551] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:23 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:24.584796 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:24.585406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:24.591846 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:24.592330 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:24.592768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:24.593453 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:24.594129 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:24.594692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:24.725074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:24.733107 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:24.734607 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:24.735788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b06b75a1-1b9e-4011-ab02-584be27984af tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.154838 Aug 22 20:07:24.736333 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1696/3552] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:24 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:25.760251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:25.761389 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:25.767838 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:25.768320 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:25.768759 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:25.769443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:25.769903 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:25.770323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:25.898496 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:25.907144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:25.908718 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:25.909895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-c6cd0677-b164-4436-a70f-4dc42e643739 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.153515 Aug 22 20:07:25.910447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1857/3553] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:25 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:26.932406 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:26.933016 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:26.939471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:26.939982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:26.940414 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:26.941106 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:26.941558 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:26.941982 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:27.067384 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:27.075663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:27.077161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:27.078339 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c025216a-a629-4160-be97-211ed1f5831e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.149824 Aug 22 20:07:27.078893 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1697/3554] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:26 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:28.100446 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:28.101038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:28.107865 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:28.108343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:28.108779 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:28.109469 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:28.109921 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:28.110341 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:28.238099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:28.246033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:28.247515 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:28.248680 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8f57cf9f-45d1-40ec-8382-0a798a4a342a tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.152112 Aug 22 20:07:28.249225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1858/3555] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:28 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:29.270306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:29.270915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:29.277325 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:29.277782 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:29.278217 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:29.278898 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:29.279350 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:29.279804 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:29.407378 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:29.415440 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:29.417478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:29.418622 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75b286b5-a79f-4dca-a391-3a9b1547ca9b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.152254 Aug 22 20:07:29.419180 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1698/3556] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:29 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:30.442098 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:30.442710 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:30.449302 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:30.449777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:30.450208 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:30.451120 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:30.451589 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:30.452038 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:30.577024 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:30.585020 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:30.586507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:30.587667 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1e46a9c6-bf6b-4f54-9ead-e52db35d32ed tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.149574 Aug 22 20:07:30.588811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1859/3557] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:30 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:31.612099 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:31.612714 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:31.619194 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:31.620370 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:31.620806 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:31.621489 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:31.621937 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:31.622354 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:31.750651 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:31.758613 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:31.760160 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:31.761283 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bf5658e-032a-4199-9239-6b9e4370b93b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.153033 Aug 22 20:07:31.761836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1699/3558] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:31 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:32.783149 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:32.783703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:32.790125 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:32.790599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:32.791030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:32.792386 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:32.792831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:32.793280 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:32.921953 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:32.929964 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:32.931443 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:32.932649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9074840e-9351-4108-9109-54e354aee7c0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.153461 Aug 22 20:07:32.933207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1860/3559] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:32 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:33.955532 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:33.956177 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:33.962536 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:33.963015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:33.963472 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:33.964207 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:33.964663 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:33.965089 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:34.096054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:34.104678 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:34.106171 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:34.107319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96c9f5fe-1779-4c98-a5c1-c395c30fd705 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1744 microversion: 2.20 time: 0.155711 Aug 22 20:07:34.107920 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1700/3560] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:33 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:35.130387 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:35.130998 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:35.137429 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:35.137901 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:35.138335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:35.139026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:35.139473 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:35.139937 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:35.268097 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:35.276675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:35.278167 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:35.279317 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9bca5d75-b84a-4c4c-9bda-94552a51a3d8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1744 microversion: 2.20 time: 0.152927 Aug 22 20:07:35.279894 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1861/3561] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:35 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:36.304490 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:36.305102 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:36.311550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:36.312076 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:36.312515 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:36.313291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:36.313747 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:36.314174 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:36.441499 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:36.450497 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:36.452015 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:36.453154 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c7fb9d2-42e9-4a3d-abd9-72f83e6d1b75 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1744 microversion: 2.20 time: 0.152631 Aug 22 20:07:36.453708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1701/3562] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:36 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:37.345514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-7adff39e-2cd1-47ea-bbe3-0bfc5a092200 req-c2de1d15-7394-4f98-82a6-29134dfff1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f36b891-c9ec-43ae-9af8-192614a38bc7", "name": "network-vif-plugged", "status": "completed", "tag": "063e27c6-e0f6-4c23-bf61-92cea49d7dee"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:07:37.355508 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-7adff39e-2cd1-47ea-bbe3-0bfc5a092200 req-c2de1d15-7394-4f98-82a6-29134dfff1e4 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:37.356003 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-7adff39e-2cd1-47ea-bbe3-0bfc5a092200 req-c2de1d15-7394-4f98-82a6-29134dfff1e4 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:37.356432 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-7adff39e-2cd1-47ea-bbe3-0bfc5a092200 req-c2de1d15-7394-4f98-82a6-29134dfff1e4 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:37.366878 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.compute.server_external_events [req-7adff39e-2cd1-47ea-bbe3-0bfc5a092200 req-c2de1d15-7394-4f98-82a6-29134dfff1e4 service nova] Creating event network-vif-plugged:063e27c6-e0f6-4c23-bf61-92cea49d7dee for instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 on hv-cinder-83538 Aug 22 20:07:37.371972 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-7adff39e-2cd1-47ea-bbe3-0bfc5a092200 req-c2de1d15-7394-4f98-82a6-29134dfff1e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090727 Aug 22 20:07:37.372583 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1862/3563] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:07:37.476265 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:37.476877 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:37.483895 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:37.484410 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:37.484848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:37.485528 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:37.485977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:37.486397 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:37.613903 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:37.621870 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:37.623365 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:37.624567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6a69d266-60cf-47ce-8a6b-805b1db2c1a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1744 microversion: 2.20 time: 0.152165 Aug 22 20:07:37.625130 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1702/3564] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:37 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:38.649529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:38.650252 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:38.657067 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:38.657576 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:38.657982 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:38.658666 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:38.659129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:38.659535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:38.788219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:38.796170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:38.797675 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:38.798823 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-ff911ba8-f4b4-4a8a-9634-6f60703c4100 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1744 microversion: 2.20 time: 0.154739 Aug 22 20:07:38.799378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1863/3565] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:38 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:39.822404 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:39.823900 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:39.830535 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:39.831285 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:39.831958 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:39.832842 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:39.833478 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:39.834088 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:39.981307 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:39.992246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:39.993868 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:39.996074 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f8ecb45-4c58-4ca2-9234-235dd2d8400e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1739 microversion: 2.20 time: 0.177548 Aug 22 20:07:39.996733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1703/3566] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:39 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 20:07:41.019938 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:41.021311 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:41.028590 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:41.029321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:41.029761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:41.030706 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:41.031354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:41.032011 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:41.172777 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:41.181758 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:41.184163 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:41.185408 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d8e312d3-4d28-4954-b32d-442da00efb58 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1739 microversion: 2.20 time: 0.169699 Aug 22 20:07:41.185974 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1864/3567] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:41 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:42.209585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:42.210192 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:42.219291 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:42.219880 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:42.220319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:42.221345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:42.222429 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:42.223441 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:42.370545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:42.380010 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:42.381501 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:42.382645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19e96459-3383-4ece-b3d5-20383a980eb3 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1739 microversion: 2.20 time: 0.177519 Aug 22 20:07:42.383433 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1704/3568] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:42 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:43.406529 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:43.407100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:43.413688 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:43.414504 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:43.415042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:43.415918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:43.416550 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:43.417668 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:43.558184 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:43.567458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:43.569478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:43.570649 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-916f983b-f641-4132-9061-adc277ed201f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1739 microversion: 2.20 time: 0.168115 Aug 22 20:07:43.571209 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1865/3569] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:43 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:44.594788 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:44.596169 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:44.603224 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:44.603839 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:44.604550 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:44.605422 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:44.606044 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:44.606470 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:44.746477 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:44.759761 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:44.761894 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:44.763077 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9ab8f45-dcb0-4920-bf5f-de6318d5ea72 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1739 microversion: 2.20 time: 0.172711 Aug 22 20:07:44.763850 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1705/3570] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:44 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:45.788089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:45.788679 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:45.794722 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:45.795194 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:45.795621 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:45.796319 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:45.796760 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:45.797173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:45.941032 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:45.950692 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:45.952564 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:45.954061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-427a3e5f-3c60-4e44-b7da-7e65c4ffb0bd tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1739 microversion: 2.20 time: 0.169813 Aug 22 20:07:45.954828 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1866/3571] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:45 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:46.978065 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:46.978753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:46.985446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:46.985935 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:46.986366 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:46.987054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:46.987608 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:46.988431 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:47.148288 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:47.157402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:47.158921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:47.160114 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eadd316e-f7e3-40b7-9d8f-66b2498c1b95 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1739 microversion: 2.20 time: 0.186440 Aug 22 20:07:47.160668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1706/3572] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:46 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:48.184858 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:48.186195 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:48.192700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:48.193458 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:48.194171 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:48.194958 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:48.195486 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:48.196013 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:48.339333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:48.348569 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:48.350142 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:48.351384 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1db4a5ba-6b16-4fde-8eb5-0d26fd68c26e tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1739 microversion: 2.20 time: 0.171678 Aug 22 20:07:48.352033 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1867/3573] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:48 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:49.376567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:49.377090 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:49.383112 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:49.383584 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:49.384041 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:49.384716 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:49.385161 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:49.385664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:49.519158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:49.527230 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:49.528768 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:49.529928 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1aceb970-4d21-4821-a0d5-9663755e6549 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1739 microversion: 2.20 time: 0.157278 Aug 22 20:07:49.530480 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1707/3574] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:49 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:50.552772 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:50.554541 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:50.561562 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:50.562042 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:50.562471 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:50.563161 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:50.563614 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:50.564061 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:50.699797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:50.708207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:50.709703 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:50.710898 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0af62978-62fe-484d-98f8-c3aeffdba33f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1721 microversion: 2.20 time: 0.161980 Aug 22 20:07:50.711452 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1868/3575] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:50 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:51.740916 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:51.741521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:51.743927 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=29 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:51.749272 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:51.749745 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:51.750173 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:51.750849 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:51.751290 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:51.751739 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:51.755533 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=83 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:51.879867 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:51.888379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:51.889902 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:51.891048 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-56cdc607-a3df-4f8a-9eb7-d2e4af5bb01f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1721 microversion: 2.20 time: 0.153980 Aug 22 20:07:51.891596 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1708/3576] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:51 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:52.914029 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:52.914581 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:52.917048 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=29 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:52.922129 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:52.922608 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:52.923043 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:52.923763 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:52.924216 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:52.924638 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:52.927357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:53.051494 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:53.059698 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:53.061202 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:53.062354 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-8d763ecc-7a15-4709-bfde-3323f419d9ea tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1664 microversion: 2.20 time: 0.152386 Aug 22 20:07:53.062912 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1869/3577] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:52 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:53.085298 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fadfb1cb-54d7-4fe7-9a5e-e5ba6d7591f4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f96b5757-db75-4599-bf46-1725435da0bd"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:07:53.087753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fadfb1cb-54d7-4fe7-9a5e-e5ba6d7591f4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:53.094789 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadfb1cb-54d7-4fe7-9a5e-e5ba6d7591f4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:53.095264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadfb1cb-54d7-4fe7-9a5e-e5ba6d7591f4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:53.095720 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadfb1cb-54d7-4fe7-9a5e-e5ba6d7591f4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:53.096402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadfb1cb-54d7-4fe7-9a5e-e5ba6d7591f4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:53.096848 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadfb1cb-54d7-4fe7-9a5e-e5ba6d7591f4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:53.097267 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fadfb1cb-54d7-4fe7-9a5e-e5ba6d7591f4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:53.341233 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [req-3d685889-78a6-4c44-9a2a-4e03c2e3b750 req-facd8137-c6fd-4dce-8c02-5739dc9ae0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f36b891-c9ec-43ae-9af8-192614a38bc7", "name": "network-vif-unplugged", "status": "completed", "tag": "063e27c6-e0f6-4c23-bf61-92cea49d7dee"}]} {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:07:53.352971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-3d685889-78a6-4c44-9a2a-4e03c2e3b750 req-facd8137-c6fd-4dce-8c02-5739dc9ae0bb service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:53.352971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-3d685889-78a6-4c44-9a2a-4e03c2e3b750 req-facd8137-c6fd-4dce-8c02-5739dc9ae0bb service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:53.352971 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [req-3d685889-78a6-4c44-9a2a-4e03c2e3b750 req-facd8137-c6fd-4dce-8c02-5739dc9ae0bb service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:53.366081 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.compute.server_external_events [req-3d685889-78a6-4c44-9a2a-4e03c2e3b750 req-facd8137-c6fd-4dce-8c02-5739dc9ae0bb service nova] Unable to find a host for instance 6f36b891-c9ec-43ae-9af8-192614a38bc7. Dropping event network-vif-unplugged {{(pid=120639) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 20:07:53.367373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [req-3d685889-78a6-4c44-9a2a-4e03c2e3b750 req-facd8137-c6fd-4dce-8c02-5739dc9ae0bb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030559 Aug 22 20:07:53.371918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1870/3578] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 22 20:07:53.389068 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fadfb1cb-54d7-4fe7-9a5e-e5ba6d7591f4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307723 Aug 22 20:07:53.389684 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1709/3579] 10.222.0.61 () {62 vars in 1364 bytes} [Mon Aug 22 20:07:53 2022] POST /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 20:07:53.512333 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4c281cdf-ba94-412b-911b-8e3e1af8fc96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:53.512831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4c281cdf-ba94-412b-911b-8e3e1af8fc96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:53.519008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c281cdf-ba94-412b-911b-8e3e1af8fc96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:53.519738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c281cdf-ba94-412b-911b-8e3e1af8fc96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:53.520207 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c281cdf-ba94-412b-911b-8e3e1af8fc96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:53.520899 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c281cdf-ba94-412b-911b-8e3e1af8fc96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:53.521357 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c281cdf-ba94-412b-911b-8e3e1af8fc96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:53.521786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4c281cdf-ba94-412b-911b-8e3e1af8fc96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:53.761553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4c281cdf-ba94-412b-911b-8e3e1af8fc96 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/os-volume_attachments/f96b5757-db75-4599-bf46-1725435da0bd" status: 202 len: 0 microversion: 2.20 time: 0.253170 Aug 22 20:07:53.762130 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1871/3580] 10.222.0.61 () {60 vars in 1457 bytes} [Mon Aug 22 20:07:53 2022] DELETE /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/os-volume_attachments/f96b5757-db75-4599-bf46-1725435da0bd => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 20:07:53.820687 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:07:53.821312 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:53.828630 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:53.829108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:53.829545 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:53.830232 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:53.830692 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:53.831110 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:53.859250 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120640) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 20:07:53.922471 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8dc5affd-2293-4586-b50b-650ccde31b7b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "POST /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/action" status: 202 len: 0 microversion: 2.20 time: 0.105728 Aug 22 20:07:53.923067 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1710/3581] 10.222.0.61 () {62 vars in 1319 bytes} [Mon Aug 22 20:07:53 2022] POST /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 20:07:53.931290 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:53.932055 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:53.938459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:53.938944 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:53.939383 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:53.940102 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:53.940619 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:53.940981 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:54.080325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:54.089296 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:54.090882 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:54.092144 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-d03de1a1-9419-4028-96f1-5a2b211335c8 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1672 microversion: 2.20 time: 0.164825 Aug 22 20:07:54.092806 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1872/3582] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:53 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:55.114446 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:55.115172 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:55.121151 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:55.121656 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:55.122098 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:55.122840 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:55.123296 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:55.123756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:55.282962 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:55.291264 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:55.293412 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:55.294578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2d262353-223c-4813-8209-81f1901c151b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.184528 Aug 22 20:07:55.295382 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1711/3583] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:55 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:56.318299 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:56.319994 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:56.327893 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:56.328786 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:56.329461 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:56.330447 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:56.331132 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:56.331802 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:56.481173 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:56.489338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:56.490822 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:56.492004 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-bdb35fc1-19b8-43c1-9cac-ba56fa410825 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.178242 Aug 22 20:07:56.492559 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1873/3584] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:56 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:57.517187 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:57.517830 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:57.524443 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:57.524934 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:57.525369 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:57.526113 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:57.526565 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:57.526991 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:57.674108 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:57.683266 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:57.684834 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:57.685996 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74d60658-729c-427f-aba5-9ba238b695a4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.172666 Aug 22 20:07:57.686556 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1712/3585] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:57 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:58.708930 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:58.709629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:58.716463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:58.716956 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:58.717395 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:58.718100 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:58.718554 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:58.718984 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:58.866348 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:58.875217 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:58.876753 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:07:58.877907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-3e190215-28b5-4441-a501-3f37f2de261c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.172956 Aug 22 20:07:58.878463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1874/3586] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:58 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:07:59.901343 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:07:59.901938 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:07:59.913563 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:59.914054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:59.914531 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:07:59.915182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:07:59.915683 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:07:59.916668 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:00.057756 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:00.066212 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:00.067822 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:00.069000 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cdc6ae43-94a7-42ee-ad38-16f0ade36d38 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.171575 Aug 22 20:08:00.069734 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1713/3587] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:07:59 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:01.093423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:01.094189 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:01.101118 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:01.101700 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:01.102225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:01.102961 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:01.103478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:01.103992 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:01.239325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:01.249597 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:01.251257 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:01.252811 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-75088415-efea-4a3e-938c-b71f5941f160 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.163178 Aug 22 20:08:01.253596 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1875/3588] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:01 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:02.276228 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:02.276844 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:02.283359 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:02.283883 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:02.284319 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:02.285005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:02.285454 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:02.285875 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:02.433257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:02.441353 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:02.442854 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:02.444028 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c5ddb13-5944-4af1-8cee-11a954fd4cd0 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.171663 Aug 22 20:08:02.444641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1714/3589] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:02 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:03.466925 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:03.467602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:03.474114 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:03.474599 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:03.475027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:03.475745 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:03.476196 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:03.476615 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:03.606168 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:03.614301 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:03.615824 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:03.616973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a6010e64-95a9-44bd-b192-81fe4d10fbc1 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.153983 Aug 22 20:08:03.617525 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1876/3590] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:03 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:04.640013 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:04.640631 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:04.647615 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:04.648126 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:04.648562 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:04.649260 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:04.649713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:04.650132 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:04.783949 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:04.791933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:04.793994 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:04.795137 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fdd17efc-087c-4488-af93-61e7648ecf6f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.159017 Aug 22 20:08:04.795713 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1715/3591] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:04 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:05.818219 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:05.818835 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:05.826022 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:05.826503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:05.826941 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:05.827629 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:05.828099 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:05.828523 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:05.956047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:05.964735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:05.966253 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:05.967412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-cc87e3d8-eb04-4d94-b24b-279d7ae9f4ae tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.153100 Aug 22 20:08:05.967999 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1877/3592] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:05 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:06.989857 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:06.990464 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:06.996881 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:06.997876 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:06.998306 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:06.998989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:06.999437 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:06.999885 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:07.126731 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:07.134941 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:07.136486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:07.138275 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2f23d06-95bb-49c6-ab1f-81a4c35e2eca tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.151716 Aug 22 20:08:07.138908 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1716/3593] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:06 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:08.160983 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:08.161595 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:08.167973 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:08.168454 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:08.169459 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:08.170151 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:08.170602 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:08.171027 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:08.298374 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:08.306343 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:08.307870 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:08.309047 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-a67df9fc-714e-4759-ad3a-d50ab5cbc072 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.151966 Aug 22 20:08:08.310170 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1878/3594] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:08 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:09.332374 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:09.332970 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:09.339292 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:09.339808 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:09.340257 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:09.340936 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:09.341385 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:09.341805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:09.478425 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:09.490933 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:09.492733 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:09.494742 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af81f7cc-3e69-4116-b034-477dbecdaea7 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.166178 Aug 22 20:08:09.495579 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1717/3595] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:09 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:10.518527 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:10.519146 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:10.525628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:10.526113 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:10.526553 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:10.527243 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:10.527716 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:10.528145 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:10.656738 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:10.664752 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:10.666247 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:10.667381 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-9fb8dc1e-0018-479a-a42c-fa4a0789b193 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.152742 Aug 22 20:08:10.667968 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1879/3596] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:10 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:11.458864 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8367506b-3470-45b9-aad5-e572c0d6eee8 req-2e38b787-56ea-4302-8b6c-16fa91405013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f36b891-c9ec-43ae-9af8-192614a38bc7", "name": "network-vif-plugged", "status": "completed", "tag": "063e27c6-e0f6-4c23-bf61-92cea49d7dee"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:08:11.470271 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8367506b-3470-45b9-aad5-e572c0d6eee8 req-2e38b787-56ea-4302-8b6c-16fa91405013 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:11.471424 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8367506b-3470-45b9-aad5-e572c0d6eee8 req-2e38b787-56ea-4302-8b6c-16fa91405013 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:11.471915 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8367506b-3470-45b9-aad5-e572c0d6eee8 req-2e38b787-56ea-4302-8b6c-16fa91405013 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:11.483863 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8367506b-3470-45b9-aad5-e572c0d6eee8 req-2e38b787-56ea-4302-8b6c-16fa91405013 service nova] Creating event network-vif-plugged:063e27c6-e0f6-4c23-bf61-92cea49d7dee for instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 on hv-cinder-83538 Aug 22 20:08:11.489100 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8367506b-3470-45b9-aad5-e572c0d6eee8 req-2e38b787-56ea-4302-8b6c-16fa91405013 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 Aug 22 20:08:11.490026 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1718/3597] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:08:11.690318 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:11.691030 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:11.697417 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:11.698271 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:11.698689 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:11.699371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:11.699855 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:11.700273 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:11.843845 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:11.852153 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:11.853661 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:11.854814 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-59ec4a98-e8fd-47b8-b4f8-96738377a5e5 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.168371 Aug 22 20:08:11.855373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1880/3598] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:11 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:12.878027 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:12.878642 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:12.885216 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:12.885700 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:12.886136 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:12.886825 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:12.887277 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:12.887732 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:13.017182 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:13.025284 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:13.026778 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:13.028005 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-acded624-170a-4f3a-903d-5ce19fe1eb7c tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.154254 Aug 22 20:08:13.028568 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1719/3599] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:12 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:14.050535 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:14.051254 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:14.057908 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:14.058391 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:14.058831 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:14.059522 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:14.060000 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:14.060423 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:14.192396 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:14.201507 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:14.203026 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:14.204236 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-dadc9e11-aa43-410e-a92a-e5e680b512b4 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1730 microversion: 2.20 time: 0.157785 Aug 22 20:08:14.204791 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1881/3600] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:14 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:15.226486 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:08:15.227086 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:08:15.234190 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:15.234664 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:15.235092 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:15.235800 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:08:15.236246 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:08:15.236662 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:08:15.364540 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:15.372585 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:15.374095 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:08:15.375247 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6786ce5c-a811-400b-b443-1bed4382d25d tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1717 microversion: 2.20 time: 0.152652 Aug 22 20:08:15.375829 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1720/3601] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:08:15 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:08:24.995342 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:08:24.996054 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:09:10.731335 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-6576928b-7748-494e-8716-5ce0135c9c73 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:10.734272 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-6576928b-7748-494e-8716-5ce0135c9c73 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:10.736291 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_api:SELECT=25 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:10.736949 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG dbcounter [-] [120639] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:10.742526 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6576928b-7748-494e-8716-5ce0135c9c73 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:10.743006 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6576928b-7748-494e-8716-5ce0135c9c73 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:10.743437 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6576928b-7748-494e-8716-5ce0135c9c73 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:10.744197 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6576928b-7748-494e-8716-5ce0135c9c73 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:10.744651 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6576928b-7748-494e-8716-5ce0135c9c73 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:10.745072 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-6576928b-7748-494e-8716-5ce0135c9c73 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:10.773628 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-6576928b-7748-494e-8716-5ce0135c9c73 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046422 Aug 22 20:09:10.774183 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1882/3602] 10.222.0.61 () {60 vars in 1343 bytes} [Mon Aug 22 20:09:10 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 20:09:10.836078 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:10.836567 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:10.838767 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:10.839421 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:10.846860 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:10.847345 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:10.847818 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:10.848519 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:10.848973 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:10.849402 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:10.875989 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 20:09:10.949709 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2959064a-617f-4b41-8bbb-09346688ccab tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 204 len: 0 microversion: 2.20 time: 0.117120 Aug 22 20:09:10.950242 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1721/3603] 10.222.0.61 () {60 vars in 1280 bytes} [Mon Aug 22 20:09:10 2022] DELETE /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 20:09:10.958929 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:10.959539 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:10.965463 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:10.965939 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:10.966371 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:10.967056 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:10.967503 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:10.967977 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:11.099438 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:09:11.107708 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:09:11.109307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:09:11.110478 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-4bff80ec-8050-48d5-b74a-80f142f20ef6 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.155385 Aug 22 20:09:11.111126 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1883/3604] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:09:10 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:09:12.133034 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:12.133729 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:12.140213 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:12.140689 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:12.141121 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:12.141802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:12.142244 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:12.142660 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:12.269003 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:09:12.276956 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:09:12.278444 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:09:12.279583 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-afe5cc32-adcb-42e8-8010-5c88603a4bbf tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1723 microversion: 2.20 time: 0.150769 Aug 22 20:09:12.280158 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1722/3605] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:09:12 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:09:13.302305 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:13.302895 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:13.309818 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:13.310265 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:13.310693 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:13.311398 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:13.311907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:13.312297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:13.377412 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:09:13.385918 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:09:13.387373 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.policy [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0dc5256349a442db02b6e5584872356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548a965fed81436fa0440d4c4db00e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120639) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 20:09:13.388563 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-0e9bd429-d0f1-42ac-84a4-d0dc9e9bf884 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 200 len: 1655 microversion: 2.20 time: 0.090172 Aug 22 20:09:13.389309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1884/3606] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:09:13 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 20:09:13.625578 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2e84a7e6-ebd5-4a75-92ac-2229b1809556 req-56a2eb66-d354-438f-96be-c0f7ca6d0579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f36b891-c9ec-43ae-9af8-192614a38bc7", "name": "network-vif-deleted", "tag": "063e27c6-e0f6-4c23-bf61-92cea49d7dee"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 20:09:13.636884 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2e84a7e6-ebd5-4a75-92ac-2229b1809556 req-56a2eb66-d354-438f-96be-c0f7ca6d0579 service nova] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:13.637282 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2e84a7e6-ebd5-4a75-92ac-2229b1809556 req-56a2eb66-d354-438f-96be-c0f7ca6d0579 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:13.637708 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2e84a7e6-ebd5-4a75-92ac-2229b1809556 req-56a2eb66-d354-438f-96be-c0f7ca6d0579 service nova] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:13.651029 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2e84a7e6-ebd5-4a75-92ac-2229b1809556 req-56a2eb66-d354-438f-96be-c0f7ca6d0579 service nova] Creating event network-vif-deleted:063e27c6-e0f6-4c23-bf61-92cea49d7dee for instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 on hv-cinder-83538 Aug 22 20:09:13.657332 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2e84a7e6-ebd5-4a75-92ac-2229b1809556 req-56a2eb66-d354-438f-96be-c0f7ca6d0579 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036880 Aug 22 20:09:13.658435 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1723/3607] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Aug 22 20:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 20:09:14.411353 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:14.412220 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:14.419338 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:14.419960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:14.420403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:14.421111 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:14.422251 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:14.422682 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:14.437084 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] HTTP exception thrown: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Request method failure captured: Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 HTTP/1.1 Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA-C5V_Gsp4bH8kfUXmgEs63SBY1yxpohpzuKV9Yb8mBzTx8OCdvv8VVekmtmgFJuOqjW3n9KIDVaKWDd1_Cohk6brQIzhpFY0pc70fjWo6Q_gEhk7NzXJegeDCZYEqT8GZyvuhtSnDNu1lbdP6oS-RVPUbJGCV59TkXsfFA2Y6ZEmD8 Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 20:09:14.438765 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}] Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: e0dc5256349a442db02b6e5584872356 Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:14.440325 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '6f36b891-c9ec-43ae-9af8-192614a38bc7'} Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:09:14.441089 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:14.442312 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:14.443403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Returning 404 to user: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:09:14.443403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-76f19451-624a-479c-9da3-8b69f50fc02b tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 404 len: 111 microversion: 2.20 time: 0.032709 Aug 22 20:09:14.443403 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1885/3608] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:09:14 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 20:09:14.450301 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b8b4629-ca66-4bb9-ac80-cd28acc3fcbe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '.version_select at 0x7f66e40e35e0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:14.478573 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b8b4629-ca66-4bb9-ac80-cd28acc3fcbe tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651097318" status: 204 len: 0 microversion: 2.20 time: 0.032393 Aug 22 20:09:14.479243 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1724/3609] 10.222.0.61 () {60 vars in 1259 bytes} [Mon Aug 22 20:09:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651097318 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 20:09:16.477510 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:16.478008 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:16.484321 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:16.484795 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:16.485225 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:16.485907 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:16.486350 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:16.486767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:16.502308 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] HTTP exception thrown: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Request method failure captured: Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 HTTP/1.1 Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA-C5V_Gsp4bH8kfUXmgEs63SBY1yxpohpzuKV9Yb8mBzTx8OCdvv8VVekmtmgFJuOqjW3n9KIDVaKWDd1_Cohk6brQIzhpFY0pc70fjWo6Q_gEhk7NzXJegeDCZYEqT8GZyvuhtSnDNu1lbdP6oS-RVPUbJGCV59TkXsfFA2Y6ZEmD8 Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 20:09:16.503881 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}] Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: e0dc5256349a442db02b6e5584872356 Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.505514 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': '6f36b891-c9ec-43ae-9af8-192614a38bc7'} Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:09:16.506378 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.507767 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.509105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Returning 404 to user: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:09:16.509105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-1779039e-179a-4dcc-834f-70a261579a19 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 404 len: 111 microversion: 2.20 time: 0.031586 Aug 22 20:09:16.509105 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1886/3610] 10.222.0.61 () {60 vars in 1280 bytes} [Mon Aug 22 20:09:16 2022] DELETE /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 20:09:16.513977 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:16.514766 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: 6f36b891-c9ec-43ae-9af8-192614a38bc7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:16.523035 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:16.523517 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:16.523987 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:16.524718 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:16.525258 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:16.525701 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:16.538641 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] HTTP exception thrown: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Request method failure captured: Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 HTTP/1.1 Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA-C5V_Gsp4bH8kfUXmgEs63SBY1yxpohpzuKV9Yb8mBzTx8OCdvv8VVekmtmgFJuOqjW3n9KIDVaKWDd1_Cohk6brQIzhpFY0pc70fjWo6Q_gEhk7NzXJegeDCZYEqT8GZyvuhtSnDNu1lbdP6oS-RVPUbJGCV59TkXsfFA2Y6ZEmD8 Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 20:09:16.540270 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}] Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: e0dc5256349a442db02b6e5584872356 Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.541836 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': '6f36b891-c9ec-43ae-9af8-192614a38bc7'} Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:09:16.542694 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. Aug 22 20:09:16.544105 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:16.545318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Returning 404 to user: Instance 6f36b891-c9ec-43ae-9af8-192614a38bc7 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:09:16.545318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8d232868-fec9-4fd8-998d-5b8252d21798 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7" status: 404 len: 111 microversion: 2.20 time: 0.031697 Aug 22 20:09:16.545318 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1725/3611] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:09:16 2022] GET /compute/v2.1/servers/6f36b891-c9ec-43ae-9af8-192614a38bc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 22 20:09:17.678070 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:17.678609 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.compute.api [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120639) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:17.684836 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:17.685307 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:17.685735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:17.686411 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:17.686876 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:17.687297 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG oslo_concurrency.lockutils [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120639) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:17.700579 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.wsgi [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] HTTP exception thrown: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Request method failure captured: Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: request: DELETE /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 HTTP/1.1 Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept: application/json Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Accept-Encoding: identity Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Connection: close Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Length: 0 Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Content-Type: application/json Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Host: 10.222.0.61 Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Openstack-System-Scope: None Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: User-Agent: python-urllib3/1.26.11 Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Auth-Token: gAAAAABjA-C5V_Gsp4bH8kfUXmgEs63SBY1yxpohpzuKV9Yb8mBzTx8OCdvv8VVekmtmgFJuOqjW3n9KIDVaKWDd1_Cohk6brQIzhpFY0pc70fjWo6Q_gEhk7NzXJegeDCZYEqT8GZyvuhtSnDNu1lbdP6oS-RVPUbJGCV59TkXsfFA2Y6ZEmD8 Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Id: None Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Domain-Name: None Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Identity-Status: Confirmed Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Is-Admin-Project: True Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Id: default Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Domain-Name: Default Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Role: member,reader Aug 22 20:09:17.702095 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Roles: member,reader Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}] Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Id: default Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Domain-Name: Default Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Id: e0dc5256349a442db02b6e5584872356 Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: X-User-Name: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: method: > Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: exception: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.704152 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: action_args: {'id': 'c0abc09a-44e2-4162-b11e-b6887fc66f36'} Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: {{(pid=120639) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:09:17.705002 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.706394 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.707735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: DEBUG nova.api.openstack.wsgi [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Returning 404 to user: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. {{(pid=120639) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:09:17.707735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO nova.api.openstack.requestlog [None req-2e4c4d54-a76e-4657-a9da-06cb3d808c13 tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 404 len: 111 microversion: 2.20 time: 0.029801 Aug 22 20:09:17.707735 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: [pid: 120639|app: 0|req: 1887/3612] 10.222.0.61 () {60 vars in 1280 bytes} [Mon Aug 22 20:09:17 2022] DELETE /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 20:09:17.712447 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 20:09:17.713052 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] [instance: c0abc09a-44e2-4162-b11e-b6887fc66f36] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 20:09:17.719905 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:17.720379 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:17.720805 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:17.721521 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Acquiring lock "5b396f6b-723e-4dee-83de-557019f2714f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 20:09:17.721968 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 20:09:17.722387 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Lock "5b396f6b-723e-4dee-83de-557019f2714f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 20:09:17.737753 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] HTTP exception thrown: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Request method failure captured: Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 HTTP/1.1 Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept: application/json Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Connection: close Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Length: 0 Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Content-Type: application/json Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Host: 10.222.0.61 Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.11 Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjA-C5V_Gsp4bH8kfUXmgEs63SBY1yxpohpzuKV9Yb8mBzTx8OCdvv8VVekmtmgFJuOqjW3n9KIDVaKWDd1_Cohk6brQIzhpFY0pc70fjWo6Q_gEhk7NzXJegeDCZYEqT8GZyvuhtSnDNu1lbdP6oS-RVPUbJGCV59TkXsfFA2Y6ZEmD8 Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Role: member,reader Aug 22 20:09:17.739255 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Roles: member,reader Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/548a965fed81436fa0440d4c4db00e2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/548a965fed81436fa0440d4c4db00e2c"}]}] Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 548a965fed81436fa0440d4c4db00e2c Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-479408540 Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Id: e0dc5256349a442db02b6e5584872356 Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-479408540-project Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: method: > Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: exception: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.740798 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: action_args: {'id': 'c0abc09a-44e2-4162-b11e-b6887fc66f36'} Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 20:09:17.741645 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. Aug 22 20:09:17.742971 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Aug 22 20:09:17.744191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] Returning 404 to user: Instance c0abc09a-44e2-4162-b11e-b6887fc66f36 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 20:09:17.744191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3437e9ce-a16e-488a-9a8d-d270eeb65b3f tempest-AttachVolumeShelveTestJSON-479408540 tempest-AttachVolumeShelveTestJSON-479408540-project] 10.222.0.61 "GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36" status: 404 len: 111 microversion: 2.20 time: 0.032028 Aug 22 20:09:17.744191 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1726/3613] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Aug 22 20:09:17 2022] GET /compute/v2.1/servers/c0abc09a-44e2-4162-b11e-b6887fc66f36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 20:09:34.067990 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:09:34.068586 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 20:09:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:11:45.004053 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:11:45.004661 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:11:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:11:47.316761 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:11:47.317266 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 20:11:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:12:03.870602 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:12:03.871162 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:12:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:12:54.076475 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:12:54.077075 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 20:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:13:28.356201 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:13:28.356704 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:13:44.669323 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:13:44.669960 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 20:13:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:15:05.012344 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:15:05.012921 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:15:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:15:07.325309 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:15:07.325797 dv-cinder-835384-22-iscsi devstack@n-api.service[120639]: Mon Aug 22 20:15:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 20:15:23.878802 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 20:15:23.879390 dv-cinder-835384-22-iscsi devstack@n-api.service[120640]: Mon Aug 22 20:15:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!